Apr 13 20:14:33 user nova-compute[71285]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 13 20:14:36 user nova-compute[71285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71285) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71285) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71285) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 13 20:14:36 user nova-compute[71285]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:14:36 user nova-compute[71285]: INFO nova.virt.driver [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 13 20:14:36 user nova-compute[71285]: INFO nova.compute.provider_config [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Acquiring lock "singleton_lock" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Acquired lock "singleton_lock" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Releasing lock "singleton_lock" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Full set of CONF: {{(pid=71285) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ******************************************************************************** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Configuration options gathered from: {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ================================================================================ {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] allow_resize_to_same_host      = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] arq_binding_timeout            = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] backdoor_port                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] backdoor_socket                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] block_device_allocate_retries  = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] block_device_allocate_retries_interval = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cert                           = self.pem {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute_monitors               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] config_dir                     = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] config_drive_format            = iso9660 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] config_source                  = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] console_host                   = user {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] control_exchange               = nova {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cpu_allocation_ratio           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] daemon                         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] debug                          = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] default_access_ip_network_name = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] default_availability_zone      = nova {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] default_ephemeral_format       = ext4 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] default_schedule_zone          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] disk_allocation_ratio          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] enable_new_services            = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] enabled_ssl_apis               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] flat_injected                  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] force_config_drive             = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] force_raw_images               = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] graceful_shutdown_timeout      = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] heal_instance_info_cache_interval = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] host                           = user {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_build_timeout         = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_delete_interval       = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_name_template         = instance-%08x {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_usage_audit           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_usage_audit_period    = month {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] internal_service_availability_zone = internal {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] key                            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] live_migration_retry_count     = 30 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_config_append              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_dir                        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_file                       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_options                    = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_rotate_interval            = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_rotate_interval_type       = days {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] log_rotation_type              = none {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] long_rpc_timeout               = 1800 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_concurrent_builds          = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_concurrent_live_migrations = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_concurrent_snapshots       = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_local_block_devices        = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_logfile_count              = 30 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] max_logfile_size_mb            = 200 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] maximum_instance_delete_attempts = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metadata_listen                = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metadata_listen_port           = 8775 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metadata_workers               = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] migrate_max_retries            = -1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] mkisofs_cmd                    = genisoimage {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] my_ip                          = 10.0.0.210 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] network_allocate_retries       = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] osapi_compute_listen_port      = 8774 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] osapi_compute_unique_server_name_scope =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] osapi_compute_workers          = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] password_length                = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] periodic_enable                = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] periodic_fuzzy_delay           = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] pointer_model                  = ps2mouse {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] preallocate_images             = none {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] publish_errors                 = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] pybasedir                      = /opt/stack/nova {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ram_allocation_ratio           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rate_limit_burst               = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rate_limit_except_level        = CRITICAL {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rate_limit_interval            = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reboot_timeout                 = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reclaim_instance_interval      = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] record                         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reimage_timeout_per_gb         = 20 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] report_interval                = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rescue_timeout                 = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reserved_host_cpus             = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reserved_host_disk_mb          = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reserved_host_memory_mb        = 512 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] reserved_huge_pages            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] resize_confirm_window          = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] resize_fs_using_block_device   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] resume_guests_state_on_host_boot = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rpc_response_timeout           = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] run_external_periodic_tasks    = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] running_deleted_instance_action = reap {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] running_deleted_instance_timeout = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler_instance_sync_interval = 120 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_down_time              = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] servicegroup_driver            = db {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] shelved_offload_time           = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] shelved_poll_interval          = 3600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] shutdown_timeout               = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] source_is_ipv6                 = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ssl_only                       = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] state_path                     = /opt/stack/data/nova {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] sync_power_state_interval      = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] sync_power_state_pool_size     = 1000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] syslog_log_facility            = LOG_USER {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] tempdir                        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] timeout_nbd                    = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] transport_url                  = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] update_resources_interval      = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_cow_images                 = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_eventlog                   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_journal                    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_json                       = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_rootwrap_daemon            = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_stderr                     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] use_syslog                     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vcpu_pin_set                   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plugging_is_fatal          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plugging_timeout           = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] virt_mkfs                      = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] volume_usage_poll_interval     = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] watch_log_file                 = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] web                            = /usr/share/spice-html5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_concurrency.disable_process_locking = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.auth_strategy              = keystone {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.compute_link_prefix        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.dhcp_domain                = novalocal {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.enable_instance_password   = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.glance_link_prefix         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.instance_list_per_project_cells = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.list_records_by_skipping_down_cells = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.local_metadata_per_cell    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.max_limit                  = 1000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.metadata_cache_expiration  = 15 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.neutron_default_tenant_id  = default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.use_forwarded_for          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.use_neutron_default_nets   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_dynamic_targets = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_jsonfile_path   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.backend_argument         = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.config_prefix            = cache.oslo {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.dead_timeout             = 60.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.debug_cache_backend      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.enable_retry_client      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.enable_socket_keepalive  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.enabled                  = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.expiration_time          = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.hashclient_retry_attempts = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_dead_retry      = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_password        =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_sasl_enabled    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.memcache_username        =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.proxies                  = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.retry_attempts           = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.retry_delay              = 0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.socket_keepalive_count   = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.socket_keepalive_idle    = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.socket_keepalive_interval = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.tls_allowed_ciphers      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.tls_cafile               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.tls_certfile             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.tls_enabled              = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cache.tls_keyfile              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.auth_section            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.auth_type               = password {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.cafile                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.certfile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.collect_timing          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.cross_az_attach         = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.debug                   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.endpoint_template       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.http_retries            = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.insecure                = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.keyfile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.os_region_name          = RegionOne {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.split_loggers           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cinder.timeout                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.cpu_dedicated_set      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.cpu_shared_set         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.image_type_exclude_list = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.resource_provider_association_refresh = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.shutdown_retry_interval = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] conductor.workers              = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] console.allowed_origins        = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] console.ssl_ciphers            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] console.ssl_minimum_version    = default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] consoleauth.token_ttl          = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.cafile                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.certfile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.collect_timing          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.connect_retries         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.connect_retry_delay     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.endpoint_override       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.insecure                = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.keyfile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.max_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.min_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.region_name             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.service_name            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.service_type            = accelerator {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.split_loggers           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.status_code_retries     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.timeout                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] cyborg.version                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.backend               = sqlalchemy {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.connection            = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.connection_debug      = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.connection_parameters =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.connection_recycle_time = 3600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.connection_trace      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.db_inc_retry_interval = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.db_max_retries        = 20 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.db_max_retry_interval = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.db_retry_interval     = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.max_overflow          = 50 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.max_pool_size         = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.max_retries           = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.mysql_enable_ndb      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.mysql_wsrep_sync_wait = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.pool_timeout          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.retry_interval        = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.slave_connection      = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] database.sqlite_synchronous    = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.backend           = sqlalchemy {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.connection        = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.connection_debug  = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.connection_parameters =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.connection_recycle_time = 3600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.connection_trace  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.db_inc_retry_interval = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.db_max_retries    = 20 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.db_max_retry_interval = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.db_retry_interval = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.max_overflow      = 50 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.max_pool_size     = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.max_retries       = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.mysql_enable_ndb  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.pool_timeout      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.retry_interval    = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.slave_connection  = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] api_database.sqlite_synchronous = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] devices.enabled_mdev_types     = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ephemeral_storage_encryption.enabled = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.api_servers             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.cafile                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.certfile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.collect_timing          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.connect_retries         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.connect_retry_delay     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.debug                   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.default_trusted_certificate_ids = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.enable_certificate_validation = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.enable_rbd_download     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.endpoint_override       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.insecure                = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.keyfile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.max_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.min_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.num_retries             = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.rbd_ceph_conf           =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.rbd_connect_timeout     = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.rbd_pool                =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.rbd_user                =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.region_name             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.service_name            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.service_type            = image {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.split_loggers           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.status_code_retries     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.timeout                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.verify_glance_signatures = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] glance.version                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] guestfs.debug                  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.config_drive_cdrom      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.config_drive_inject_password = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.enable_remotefx         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.instances_path_share    =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.limit_cpu_features      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.use_multipath_io        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.vswitch_name            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] mks.enabled                    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.manager_interval   = 2400 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.precache_concurrency = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.remove_unused_base_images = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] image_cache.subdirectory_name  = _base {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.api_max_retries         = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.api_retry_interval      = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.auth_section            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.auth_type               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.cafile                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.certfile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.collect_timing          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.connect_retries         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.connect_retry_delay     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.endpoint_override       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.insecure                = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.keyfile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.max_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.min_version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.partition_key           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.peer_list               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.region_name             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.serial_console_state_timeout = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.service_name            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.service_type            = baremetal {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.split_loggers           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.status_code_retries     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.timeout                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ironic.version                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] key_manager.fixed_key          = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.barbican_api_version  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.barbican_endpoint     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.barbican_endpoint_type = public {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.barbican_region_name  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.cafile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.certfile              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.collect_timing        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.insecure              = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.keyfile               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.number_of_retries     = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.retry_delay           = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.send_service_user_token = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.split_loggers         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.timeout               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.verify_ssl            = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican.verify_ssl_path       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.auth_section = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.auth_type = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.cafile   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.certfile = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.collect_timing = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.insecure = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.keyfile  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.split_loggers = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] barbican_service_user.timeout  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.approle_role_id          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.approle_secret_id        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.cafile                   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.certfile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.collect_timing           = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.insecure                 = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.keyfile                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.kv_mountpoint            = secret {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.kv_version               = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.namespace                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.root_token_id            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.split_loggers            = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.ssl_ca_crt_file          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.timeout                  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.use_ssl                  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.cafile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.certfile              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.collect_timing        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.connect_retries       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.connect_retry_delay   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.endpoint_override     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.insecure              = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.keyfile               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.max_version           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.min_version           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.region_name           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.service_name          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.service_type          = identity {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.split_loggers         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.status_code_retries   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.timeout               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] keystone.version               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.connection_uri         =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_mode               = custom {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: WARNING oslo_config.cfg [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_power_governor_high = performance {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_power_management   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.device_detach_attempts = 8 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.device_detach_timeout  = 20 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.disk_cachemodes        = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.disk_prefix            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.enabled_perf_events    = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.file_backed_memory     = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.gid_maps               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.hw_disk_discard        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.hw_machine_type        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_rbd_pool        = rbd {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_type            = default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.images_volume_group    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.inject_key             = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.inject_partition       = -2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.inject_password        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.iscsi_iface            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.iser_use_multipath     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_downtime = 500 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_inbound_addr = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_scheme  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_timeout_action = abort {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_tunnelled = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: WARNING oslo_config.cfg [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 13 20:14:36 user nova-compute[71285]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 13 20:14:36 user nova-compute[71285]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 13 20:14:36 user nova-compute[71285]: and ``live_migration_inbound_addr`` respectively.
Apr 13 20:14:36 user nova-compute[71285]: ).  Its value may be silently ignored in the future.
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.live_migration_with_native_tls = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.max_queues             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.nfs_mount_options      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_pcie_ports         = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.pmem_namespaces        = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.quobyte_client_cfg     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rbd_secret_uuid        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rbd_user               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rescue_image_id        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rescue_kernel_id       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.rx_queue_size          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.smbfs_mount_options    =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.snapshot_compression   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.snapshot_image_format  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.sparse_logical_volumes = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.swtpm_enabled          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.swtpm_group            = tss {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.swtpm_user             = tss {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.sysinfo_serial         = unique {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.tx_queue_size          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.uid_maps               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.use_virtio_for_bridges = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.virt_type              = kvm {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.volume_clear           = zero {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.volume_clear_size      = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.volume_use_multipath   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_cache_path   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.auth_section           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.auth_type              = password {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.cafile                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.certfile               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.collect_timing         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.connect_retries        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.connect_retry_delay    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.default_floating_pool  = public {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.endpoint_override      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.extension_sync_interval = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.http_retries           = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.insecure               = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.keyfile                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.max_version            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.min_version            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.ovs_bridge             = br-int {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.physnets               = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.region_name            = RegionOne {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.service_metadata_proxy = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.service_name           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.service_type           = network {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.split_loggers          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.status_code_retries    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.timeout                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] neutron.version                = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] notifications.bdms_in_notifications = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] notifications.default_level    = INFO {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] notifications.notification_format = unversioned {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] notifications.notify_on_state_change = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] pci.alias                      = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] pci.device_spec                = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] pci.report_in_placement        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.auth_section         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.auth_type            = password {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.cafile               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.certfile             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.collect_timing       = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.connect_retries      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.connect_retry_delay  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.default_domain_id    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.default_domain_name  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.domain_id            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.domain_name          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.endpoint_override    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.insecure             = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.keyfile              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.max_version          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.min_version          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.password             = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.project_domain_id    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.project_domain_name  = Default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.project_id           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.project_name         = service {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.region_name          = RegionOne {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.service_name         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.service_type         = placement {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.split_loggers        = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.status_code_retries  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.system_scope         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.timeout              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.trust_id             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.user_domain_id       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.user_domain_name     = Default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.user_id              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.username             = placement {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] placement.version              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.cores                    = 20 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.count_usage_from_placement = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.injected_file_content_bytes = 10240 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.injected_file_path_length = 255 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.injected_files           = 5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.instances                = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.key_pairs                = 100 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.metadata_items           = 128 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.ram                      = 51200 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.recheck_quota            = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.server_group_members     = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] quota.server_groups            = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rdp.enabled                    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.image_metadata_prefilter = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.max_attempts         = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.max_placement_results = 1000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] scheduler.workers              = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.host_subset_size = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.isolated_hosts = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.isolated_images = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.pci_in_placement = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.track_instance_changes = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metrics.required               = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metrics.weight_multiplier      = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] metrics.weight_setting         = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.enabled         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.port_range      = 10000:20000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] serial_console.serialproxy_port = 6083 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.auth_section      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.auth_type         = password {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.cafile            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.certfile          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.collect_timing    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.insecure          = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.keyfile           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.send_service_user_token = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.split_loggers     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] service_user.timeout           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.agent_enabled            = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.enabled                  = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.html5proxy_port          = 6082 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.image_compression        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.jpeg_compression         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.playback_compression     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.server_listen            = 127.0.0.1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.streaming_mode           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] spice.zlib_compression         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] upgrade_levels.baseapi         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] upgrade_levels.cert            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] upgrade_levels.compute         = auto {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] upgrade_levels.conductor       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] upgrade_levels.scheduler       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.cafile = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.certfile = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.insecure = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vendordata_dynamic_auth.timeout = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.api_retry_count         = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.ca_file                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.cache_prefix            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.cluster_name            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.connection_pool_size    = 10 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.console_delay_seconds   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.datastore_regex         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.host_ip                 = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.host_password           = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.host_port               = 443 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.host_username           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.insecure                = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.integration_bridge      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.maximum_objects         = 100 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.pbm_default_policy      = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.pbm_enabled             = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.pbm_wsdl_location       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.serial_port_proxy_uri   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.serial_port_service_uri = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.task_poll_interval      = 0.5 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.use_linked_clone        = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.vnc_keymap              = en-us {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.vnc_port                = 5900 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vmware.vnc_port_total          = 10000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.auth_schemes               = ['none'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.enabled                    = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.novncproxy_port            = 6080 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.vencrypt_ca_certs          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.vencrypt_client_cert       = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vnc.vencrypt_client_key        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.disable_rootwrap   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.enable_numa_live_migration = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.libvirt_disable_apic = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.client_socket_timeout     = 900 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.default_pool_size         = 1000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.keep_alive                = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.max_header_line           = 16384 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.ssl_ca_file               = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.ssl_cert_file             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.ssl_key_file              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.tcp_keepidle              = 600 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] zvm.ca_file                    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] zvm.cloud_connector_url        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] zvm.reachable_timeout          = 300 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.enforce_new_defaults = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.enforce_scope      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.policy_default_rule = default {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.connection_string     = messaging:// {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.enabled               = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.es_doc_type           = notification {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.es_scroll_size        = 10000 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.es_scroll_time        = 2m {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.filter_error_trace    = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.sentinel_service_name = mymaster {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.socket_timeout        = 0.1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] profiler.trace_sqlalchemy      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] remote_debug.host              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] remote_debug.port              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_notifications.retry = -1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.auth_section        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.auth_type           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.cafile              = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.certfile            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.collect_timing      = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.connect_retries     = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.connect_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.endpoint_id         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.endpoint_override   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.insecure            = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.keyfile             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.max_version         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.min_version         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.region_name         = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.service_name        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.service_type        = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.split_loggers       = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.status_code_retries = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.status_code_retry_delay = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.timeout             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.valid_interfaces    = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_limit.version             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_reports.file_event_handler = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] oslo_reports.log_dir           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.group  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] vif_plug_ovs_privileged.user   = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.isolate_vif         = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] os_brick.lock_path             = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.capabilities   = [21] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.group          = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.helper_command = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] privsep_osbrick.user           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.group           = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.helper_command  = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] nova_sys_admin.user            = None {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG oslo_service.service [None req-a7c53782-4a91-4fea-ac7a-ebba04daec71 None None] ******************************************************************************** {{(pid=71285) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 13 20:14:36 user nova-compute[71285]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 13 20:14:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Starting native event thread {{(pid=71285) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Starting green dispatch thread {{(pid=71285) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Starting connection event dispatch thread {{(pid=71285) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Connecting to libvirt: qemu:///system {{(pid=71285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 13 20:14:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fdc6cab65c0> {{(pid=71285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 13 20:14:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fdc6cab65c0> {{(pid=71285) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 13 20:14:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Connection event '1' reason 'None'
Apr 13 20:14:37 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 20:14:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.mount [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Initialising _HostMountState generation 0 {{(pid=71285) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host capabilities <capabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <host>
Apr 13 20:14:44 user nova-compute[71285]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 13 20:14:44 user nova-compute[71285]:     <cpu>
Apr 13 20:14:44 user nova-compute[71285]:       <arch>x86_64</arch>
Apr 13 20:14:44 user nova-compute[71285]:       <model>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <microcode version='1070'/>
Apr 13 20:14:44 user nova-compute[71285]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='osxsave'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='invtsc'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='rsba'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature name='skip-l1dfl-vmentry'/>
Apr 13 20:14:44 user nova-compute[71285]:       <pages unit='KiB' size='4'/>
Apr 13 20:14:44 user nova-compute[71285]:       <pages unit='KiB' size='2048'/>
Apr 13 20:14:44 user nova-compute[71285]:     </cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <power_management>
Apr 13 20:14:44 user nova-compute[71285]:       <suspend_mem/>
Apr 13 20:14:44 user nova-compute[71285]:       <suspend_disk/>
Apr 13 20:14:44 user nova-compute[71285]:       <suspend_hybrid/>
Apr 13 20:14:44 user nova-compute[71285]:     </power_management>
Apr 13 20:14:44 user nova-compute[71285]:     <iommu support='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <migration_features>
Apr 13 20:14:44 user nova-compute[71285]:       <live/>
Apr 13 20:14:44 user nova-compute[71285]:       <uri_transports>
Apr 13 20:14:44 user nova-compute[71285]:         <uri_transport>tcp</uri_transport>
Apr 13 20:14:44 user nova-compute[71285]:         <uri_transport>rdma</uri_transport>
Apr 13 20:14:44 user nova-compute[71285]:       </uri_transports>
Apr 13 20:14:44 user nova-compute[71285]:     </migration_features>
Apr 13 20:14:44 user nova-compute[71285]:     <topology>
Apr 13 20:14:44 user nova-compute[71285]:       <cells num='2'>
Apr 13 20:14:44 user nova-compute[71285]:         <cell id='0'>
Apr 13 20:14:44 user nova-compute[71285]:           <memory unit='KiB'>8152920</memory>
Apr 13 20:14:44 user nova-compute[71285]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 13 20:14:44 user nova-compute[71285]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 20:14:44 user nova-compute[71285]:           <distances>
Apr 13 20:14:44 user nova-compute[71285]:             <sibling id='0' value='10'/>
Apr 13 20:14:44 user nova-compute[71285]:             <sibling id='1' value='20'/>
Apr 13 20:14:44 user nova-compute[71285]:           </distances>
Apr 13 20:14:44 user nova-compute[71285]:           <cpus num='6'>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 13 20:14:44 user nova-compute[71285]:           </cpus>
Apr 13 20:14:44 user nova-compute[71285]:         </cell>
Apr 13 20:14:44 user nova-compute[71285]:         <cell id='1'>
Apr 13 20:14:44 user nova-compute[71285]:           <memory unit='KiB'>8255100</memory>
Apr 13 20:14:44 user nova-compute[71285]:           <pages unit='KiB' size='4'>2063775</pages>
Apr 13 20:14:44 user nova-compute[71285]:           <pages unit='KiB' size='2048'>0</pages>
Apr 13 20:14:44 user nova-compute[71285]:           <distances>
Apr 13 20:14:44 user nova-compute[71285]:             <sibling id='0' value='20'/>
Apr 13 20:14:44 user nova-compute[71285]:             <sibling id='1' value='10'/>
Apr 13 20:14:44 user nova-compute[71285]:           </distances>
Apr 13 20:14:44 user nova-compute[71285]:           <cpus num='6'>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 13 20:14:44 user nova-compute[71285]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 13 20:14:44 user nova-compute[71285]:           </cpus>
Apr 13 20:14:44 user nova-compute[71285]:         </cell>
Apr 13 20:14:44 user nova-compute[71285]:       </cells>
Apr 13 20:14:44 user nova-compute[71285]:     </topology>
Apr 13 20:14:44 user nova-compute[71285]:     <cache>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 13 20:14:44 user nova-compute[71285]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 13 20:14:44 user nova-compute[71285]:     </cache>
Apr 13 20:14:44 user nova-compute[71285]:     <secmodel>
Apr 13 20:14:44 user nova-compute[71285]:       <model>apparmor</model>
Apr 13 20:14:44 user nova-compute[71285]:       <doi>0</doi>
Apr 13 20:14:44 user nova-compute[71285]:     </secmodel>
Apr 13 20:14:44 user nova-compute[71285]:     <secmodel>
Apr 13 20:14:44 user nova-compute[71285]:       <model>dac</model>
Apr 13 20:14:44 user nova-compute[71285]:       <doi>0</doi>
Apr 13 20:14:44 user nova-compute[71285]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 13 20:14:44 user nova-compute[71285]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 13 20:14:44 user nova-compute[71285]:     </secmodel>
Apr 13 20:14:44 user nova-compute[71285]:   </host>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='alpha'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>clipper</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='armv6l'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>spitz</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>nuri</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>kzm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>z2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>tosa</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n810</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>terrier</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>midway</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>microbit</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>verdex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>highbank</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>akita</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>connex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>collie</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='armv7l'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>spitz</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>nuri</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>kzm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>z2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>tosa</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n810</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>terrier</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>midway</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>microbit</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>verdex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>highbank</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>akita</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>connex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>collie</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='aarch64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>integratorcp</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>borzoi</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>spitz</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>nuri</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-b1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatileab</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>kzm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>musca-a</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>smdkc210</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>z2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>tosa</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>sabrelite</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-eb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n810</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>n800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>versatilepb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>terrier</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mainstone</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>midway</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>musicpal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>microbit</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cubieboard</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>verdex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduino2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>raspi3b</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>raspi2b</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>cheetah</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>highbank</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>akita</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>connex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>collie</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>raspi0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <acpi default='on' toggle='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='cris'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='i686'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>isapc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>microvm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='kvm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <pae/>
Apr 13 20:14:44 user nova-compute[71285]:       <nonpae/>
Apr 13 20:14:44 user nova-compute[71285]:       <acpi default='on' toggle='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:       <apic default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='m68k'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>an5206</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>q800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>next-cube</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='microblaze'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='microblazeel'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='mips'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>malta</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='mipsel'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>malta</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='mips64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>malta</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>pica61</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>magnum</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='mips64el'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>malta</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mipssim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>pica61</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>magnum</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='16'>boston</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='ppc'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mac99</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>40p</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>taihu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='ppc64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>taihu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>40p</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mac99</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='ppc64le'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>taihu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ppce500</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>40p</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>pegasos2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>bamboo</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>g3beige</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>mac99</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sam460ex</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>ref405ep</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2048'>powernv8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='riscv32'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='8'>spike</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>opentitan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='8'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='riscv64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='8'>spike</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='5'>sifive_u</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>shakti_c</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sifive_e</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='8'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='s390x'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='sh4'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>shix</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>r2d</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='sh4eb'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>shix</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>r2d</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='sparc'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>SS-5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>SS-20</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>LX</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>SS-4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>SS-10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>Voyager</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='sparc64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sun4u</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>niagara</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>sun4v</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='x86_64'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>64</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>x-remote</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='1'>isapc</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>microvm</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='kvm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <acpi default='on' toggle='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:       <apic default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='xtensa'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>sim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>kc705</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ml605</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx200</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx60</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]:   <guest>
Apr 13 20:14:44 user nova-compute[71285]:     <os_type>hvm</os_type>
Apr 13 20:14:44 user nova-compute[71285]:     <arch name='xtensaeb'>
Apr 13 20:14:44 user nova-compute[71285]:       <wordsize>32</wordsize>
Apr 13 20:14:44 user nova-compute[71285]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='4'>sim</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>kc705</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ml605</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>virt</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx200</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>lx60</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 13 20:14:44 user nova-compute[71285]:       <domain type='qemu'/>
Apr 13 20:14:44 user nova-compute[71285]:     </arch>
Apr 13 20:14:44 user nova-compute[71285]:     <features>
Apr 13 20:14:44 user nova-compute[71285]:       <cpuselection/>
Apr 13 20:14:44 user nova-compute[71285]:       <deviceboot/>
Apr 13 20:14:44 user nova-compute[71285]:       <disksnapshot default='on' toggle='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     </features>
Apr 13 20:14:44 user nova-compute[71285]:   </guest>
Apr 13 20:14:44 user nova-compute[71285]: </capabilities>
Apr 13 20:14:44 user nova-compute[71285]: 
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-q35-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>i686</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='288'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'/>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='lm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-q35-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>i686</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='288'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'/>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='lm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-i440fx-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>i686</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='255'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'/>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='lm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ide</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-i386</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-i440fx-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>i686</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='255'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'/>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='lm'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ide</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-q35-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>x86_64</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='288'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>efi</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='invtsc'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='rsba'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-q35-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>x86_64</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='288'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>efi</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='invtsc'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='rsba'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-i440fx-6.2</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>x86_64</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='255'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>efi</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='invtsc'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='rsba'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ide</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 13 20:14:44 user nova-compute[71285]: <domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 13 20:14:44 user nova-compute[71285]:   <domain>kvm</domain>
Apr 13 20:14:44 user nova-compute[71285]:   <machine>pc-i440fx-jammy</machine>
Apr 13 20:14:44 user nova-compute[71285]:   <arch>x86_64</arch>
Apr 13 20:14:44 user nova-compute[71285]:   <vcpu max='255'/>
Apr 13 20:14:44 user nova-compute[71285]:   <iothreads supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:   <os supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='firmware'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>efi</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:     <loader supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>rom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pflash</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='readonly'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>yes</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='secure'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>no</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </loader>
Apr 13 20:14:44 user nova-compute[71285]:   </os>
Apr 13 20:14:44 user nova-compute[71285]:   <cpu>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-passthrough' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='hostPassthroughMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='maximum' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='maximumMigratable'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>on</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>off</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='host-model' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <vendor>Intel</vendor>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ss'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='vmx'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pcid'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='hypervisor'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arat'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='tsc_adjust'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='umip'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='md-clear'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='arch-capabilities'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='invtsc'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibpb'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='ibrs'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-stibp'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='amd-ssbd'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='rsba'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='require' name='pschange-mc-no'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='erms'/>
Apr 13 20:14:44 user nova-compute[71285]:       <feature policy='disable' name='xsaveopt'/>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:     <mode name='custom' supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>qemu64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>qemu32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>phenom</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>pentium</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>n270</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm64</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>kvm32</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>coreduo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>core2duo</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>athlon</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Westmere</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Snowridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Skylake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>SandyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Penryn</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G5</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G4</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G3</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Opteron_G2</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Opteron_G1</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>IvyBridge</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Icelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Haswell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Rome</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-Milan</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC-IBPB</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>EPYC</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Dhyana</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cooperlake</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>Conroe</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Cascadelake-Server</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-noTSX</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell-IBRS</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='no'>Broadwell</model>
Apr 13 20:14:44 user nova-compute[71285]:       <model usable='yes'>486</model>
Apr 13 20:14:44 user nova-compute[71285]:     </mode>
Apr 13 20:14:44 user nova-compute[71285]:   </cpu>
Apr 13 20:14:44 user nova-compute[71285]:   <memoryBacking supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:     <enum name='sourceType'>
Apr 13 20:14:44 user nova-compute[71285]:       <value>file</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>anonymous</value>
Apr 13 20:14:44 user nova-compute[71285]:       <value>memfd</value>
Apr 13 20:14:44 user nova-compute[71285]:     </enum>
Apr 13 20:14:44 user nova-compute[71285]:   </memoryBacking>
Apr 13 20:14:44 user nova-compute[71285]:   <devices>
Apr 13 20:14:44 user nova-compute[71285]:     <disk supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='diskDevice'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>disk</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cdrom</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>floppy</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>lun</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='bus'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ide</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>fdc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sata</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </disk>
Apr 13 20:14:44 user nova-compute[71285]:     <graphics supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='type'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>sdl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vnc</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>spice</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egl-headless</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </graphics>
Apr 13 20:14:44 user nova-compute[71285]:     <video supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='modelType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>cirrus</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>vmvga</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>qxl</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>none</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>bochs</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>ramfb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </video>
Apr 13 20:14:44 user nova-compute[71285]:     <hostdev supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='mode'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>subsystem</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='startupPolicy'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>default</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>mandatory</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>requisite</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>optional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='subsysType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>usb</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>pci</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>scsi</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='capsType'/>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='pciBackend'/>
Apr 13 20:14:44 user nova-compute[71285]:     </hostdev>
Apr 13 20:14:44 user nova-compute[71285]:     <rng supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtio-non-transitional</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>random</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>egd</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>builtin</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </rng>
Apr 13 20:14:44 user nova-compute[71285]:     <filesystem supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='driverType'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>path</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>handle</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>virtiofs</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </filesystem>
Apr 13 20:14:44 user nova-compute[71285]:     <tpm supported='yes'>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='model'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-tis</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>tpm-crb</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:       <enum name='backendModel'>
Apr 13 20:14:44 user nova-compute[71285]:         <value>passthrough</value>
Apr 13 20:14:44 user nova-compute[71285]:         <value>emulator</value>
Apr 13 20:14:44 user nova-compute[71285]:       </enum>
Apr 13 20:14:44 user nova-compute[71285]:     </tpm>
Apr 13 20:14:44 user nova-compute[71285]:   </devices>
Apr 13 20:14:44 user nova-compute[71285]:   <features>
Apr 13 20:14:44 user nova-compute[71285]:     <gic supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:     <vmcoreinfo supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <genid supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backingStoreInput supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <backup supported='yes'/>
Apr 13 20:14:44 user nova-compute[71285]:     <sev supported='no'/>
Apr 13 20:14:44 user nova-compute[71285]:   </features>
Apr 13 20:14:44 user nova-compute[71285]: </domainCapabilities>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71285) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71285) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Checking secure boot support for host arch (x86_64) {{(pid=71285) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Secure Boot support detected
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] cpu compare xml: <cpu match="exact">
Apr 13 20:14:44 user nova-compute[71285]:   <model>Nehalem</model>
Apr 13 20:14:44 user nova-compute[71285]: </cpu>
Apr 13 20:14:44 user nova-compute[71285]:  {{(pid=71285) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.virt.node [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Generated node identity 53cf08c2-ffbf-4a19-b42f-a7314bd542ef
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.virt.node [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Wrote node identity 53cf08c2-ffbf-4a19-b42f-a7314bd542ef to /opt/stack/data/nova/compute_id
Apr 13 20:14:44 user nova-compute[71285]: WARNING nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Compute nodes ['53cf08c2-ffbf-4a19-b42f-a7314bd542ef'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 13 20:14:44 user nova-compute[71285]: WARNING nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 13 20:14:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:14:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:14:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Hypervisor/Node resource view: name=user free_ram=10850MB free_disk=27.194564819335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:14:44 user nova-compute[71285]: WARNING nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] No compute node record for user:53cf08c2-ffbf-4a19-b42f-a7314bd542ef: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 53cf08c2-ffbf-4a19-b42f-a7314bd542ef could not be found.
Apr 13 20:14:44 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Compute node record created for user:user with uuid: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:14:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:14:45 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [req-d2a3486f-e7ac-4f38-8940-9c28eeab4237] Created resource provider record via placement API for resource provider with UUID 53cf08c2-ffbf-4a19-b42f-a7314bd542ef and name user.
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71285) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 13 20:14:45 user nova-compute[71285]: INFO nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] kernel doesn't support AMD SEV
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Libvirt baseline CPU <cpu>
Apr 13 20:14:45 user nova-compute[71285]:   <arch>x86_64</arch>
Apr 13 20:14:45 user nova-compute[71285]:   <model>Nehalem</model>
Apr 13 20:14:45 user nova-compute[71285]:   <vendor>Intel</vendor>
Apr 13 20:14:45 user nova-compute[71285]:   <topology sockets="6" cores="1" threads="1"/>
Apr 13 20:14:45 user nova-compute[71285]: </cpu>
Apr 13 20:14:45 user nova-compute[71285]:  {{(pid=71285) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Updated inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Updating resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef generation from 0 to 1 during operation: update_inventory {{(pid=71285) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Updating resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef generation from 1 to 2 during operation: update_traits {{(pid=71285) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.644s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.service [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Creating RPC server for service compute {{(pid=71285) start /opt/stack/nova/nova/service.py:182}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.service [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Join ServiceGroup membership for this service compute {{(pid=71285) start /opt/stack/nova/nova/service.py:199}}
Apr 13 20:14:45 user nova-compute[71285]: DEBUG nova.servicegroup.drivers.db [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71285) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 13 20:15:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:15:36 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:15:36 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=10213MB free_disk=27.108352661132812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:15:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.143s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:16:38 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:16:38 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=10193MB free_disk=27.151958465576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:16:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:17:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:17:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:17:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:17:38 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:17:38 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=10212MB free_disk=26.930435180664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:17:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:17:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:17:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:18:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:18:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=9437MB free_disk=26.952709197998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:18:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:18:52 user nova-compute[71285]: INFO nova.compute.claims [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Claim successful on node user
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:52 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.113s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:18:53 user nova-compute[71285]: INFO nova.compute.claims [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Claim successful on node user
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:18:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:18:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Creating image(s)
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:18:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.policy [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cb2df6092c342e0b0f44c37abb4a88a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3042be539b4749b37156c0e5a9d907', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:18:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Creating image(s)
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "/opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "/opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.part --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.virt.images [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 89a0e641-f418-4fdd-8f20-480666e0188c was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:18:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.part /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.part /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.converted" returned: 0 in 0.125s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG nova.policy [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b50309fc4b92451f8cc40e92b10861ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da6301bd811748429fd4bc6b1205e07d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.839s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:54 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpj5kam6rl/privsep.sock']
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.291s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:54 user sudo[80013]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpj5kam6rl/privsep.sock
Apr 13 20:18:54 user sudo[80013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 20:18:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Successfully created port: 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:18:56 user sudo[80013]: pam_unix(sudo:session): session closed for user root
Apr 13 20:18:56 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Spawned new privsep daemon via rootwrap
Apr 13 20:18:56 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 20:18:56 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 20:18:56 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 13 20:18:56 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80016
Apr 13 20:18:56 user nova-compute[71285]: WARNING oslo_privsep.priv_context [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] privsep daemon already running
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk 1073741824" returned: 0 in 0.053s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.211s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Successfully created port: 647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk 1073741824" returned: 0 in 0.044s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Cannot resize image /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'migration_context' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Ensure instance console log exists: /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:18:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Cannot resize image /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lazy-loading 'migration_context' on Instance uuid b6fde0f5-70fc-49a5-96f9-b67ed1662a10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Ensure instance console log exists: /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:18:57 user nova-compute[71285]: INFO nova.compute.claims [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Claim successful on node user
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:18:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:18:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Creating image(s)
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:57 user nova-compute[71285]: DEBUG nova.policy [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk 1073741824" returned: 0 in 0.042s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Successfully updated port: 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Cannot resize image /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'migration_context' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing instance network info cache due to event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:18:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance network_info: |[{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start _get_guest_xml network_info=[{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:18:59 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:18:59 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-348825334',display_name='tempest-ServerStableDeviceRescueTest-server-348825334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-348825334',id=1,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1U5QECB3FwD62l+VoD4RcrdT4EaNcIQSWZpqPdFG+5sUJl6aJ5L9iAijKA5SZiYUs+UXX2i0SuapMZsoqaM+jDDv+ifTc3jkJuvkYwnliPrzr/xR1kynUx8tBW306ag==',key_name='tempest-keypair-1968906009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3042be539b4749b37156c0e5a9d907',ramdisk_id='',reservation_id='r-pm90g9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1796731705',owner_user_name='tempest-ServerStableDeviceRescueTest-1796731705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb2df6092c342e0b0f44c37abb4a88a',uuid=54d25a51-cd3f-4ea1-9de4-66de37fcb476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converting VIF {"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.objects.instance [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'pci_devices' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Successfully updated port: 647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:18:59 user nova-compute[71285]:   <uuid>54d25a51-cd3f-4ea1-9de4-66de37fcb476</uuid>
Apr 13 20:18:59 user nova-compute[71285]:   <name>instance-00000001</name>
Apr 13 20:18:59 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:18:59 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:18:59 user nova-compute[71285]:   <metadata>
Apr 13 20:18:59 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:18:59 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-348825334</nova:name>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:18:59</nova:creationTime>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:18:59 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:18:59 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:owner>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:user uuid="5cb2df6092c342e0b0f44c37abb4a88a">tempest-ServerStableDeviceRescueTest-1796731705-project-member</nova:user>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:project uuid="4c3042be539b4749b37156c0e5a9d907">tempest-ServerStableDeviceRescueTest-1796731705</nova:project>
Apr 13 20:18:59 user nova-compute[71285]:       </nova:owner>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:18:59 user nova-compute[71285]:       <nova:ports>
Apr 13 20:18:59 user nova-compute[71285]:         <nova:port uuid="55d65e58-cf52-4044-a5c3-b7d5c4bf4bad">
Apr 13 20:18:59 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 20:18:59 user nova-compute[71285]:         </nova:port>
Apr 13 20:18:59 user nova-compute[71285]:       </nova:ports>
Apr 13 20:18:59 user nova-compute[71285]:     </nova:instance>
Apr 13 20:18:59 user nova-compute[71285]:   </metadata>
Apr 13 20:18:59 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:18:59 user nova-compute[71285]:     <system>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="serial">54d25a51-cd3f-4ea1-9de4-66de37fcb476</entry>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="uuid">54d25a51-cd3f-4ea1-9de4-66de37fcb476</entry>
Apr 13 20:18:59 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:18:59 user nova-compute[71285]:     </system>
Apr 13 20:18:59 user nova-compute[71285]:   </sysinfo>
Apr 13 20:18:59 user nova-compute[71285]:   <os>
Apr 13 20:18:59 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:18:59 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:18:59 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:18:59 user nova-compute[71285]:   </os>
Apr 13 20:18:59 user nova-compute[71285]:   <features>
Apr 13 20:18:59 user nova-compute[71285]:     <acpi/>
Apr 13 20:18:59 user nova-compute[71285]:     <apic/>
Apr 13 20:18:59 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:18:59 user nova-compute[71285]:   </features>
Apr 13 20:18:59 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:18:59 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:18:59 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:18:59 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:18:59 user nova-compute[71285]:   </clock>
Apr 13 20:18:59 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:18:59 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:18:59 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:18:59 user nova-compute[71285]:   </cpu>
Apr 13 20:18:59 user nova-compute[71285]:   <devices>
Apr 13 20:18:59 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:18:59 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:18:59 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk"/>
Apr 13 20:18:59 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:18:59 user nova-compute[71285]:     </disk>
Apr 13 20:18:59 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:18:59 user nova-compute[71285]:       <mac address="fa:16:3e:06:e5:44"/>
Apr 13 20:18:59 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:18:59 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:18:59 user nova-compute[71285]:       <target dev="tap55d65e58-cf"/>
Apr 13 20:18:59 user nova-compute[71285]:     </interface>
Apr 13 20:18:59 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:18:59 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/console.log" append="off"/>
Apr 13 20:18:59 user nova-compute[71285]:     </serial>
Apr 13 20:18:59 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:18:59 user nova-compute[71285]:     <video>
Apr 13 20:18:59 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:18:59 user nova-compute[71285]:     </video>
Apr 13 20:18:59 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:18:59 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:18:59 user nova-compute[71285]:     </rng>
Apr 13 20:18:59 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:18:59 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:18:59 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:18:59 user nova-compute[71285]:     </memballoon>
Apr 13 20:18:59 user nova-compute[71285]:   </devices>
Apr 13 20:18:59 user nova-compute[71285]: </domain>
Apr 13 20:18:59 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-348825334',display_name='tempest-ServerStableDeviceRescueTest-server-348825334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-348825334',id=1,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1U5QECB3FwD62l+VoD4RcrdT4EaNcIQSWZpqPdFG+5sUJl6aJ5L9iAijKA5SZiYUs+UXX2i0SuapMZsoqaM+jDDv+ifTc3jkJuvkYwnliPrzr/xR1kynUx8tBW306ag==',key_name='tempest-keypair-1968906009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c3042be539b4749b37156c0e5a9d907',ramdisk_id='',reservation_id='r-pm90g9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1796731705',owner_user_name='tempest-ServerStableDeviceRescueTest-1796731705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb2df6092c342e0b0f44c37abb4a88a',uuid=54d25a51-cd3f-4ea1-9de4-66de37fcb476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converting VIF {"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG os_vif [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquired lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Created schema index Interface.name {{(pid=71285) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Created schema index Port.name {{(pid=71285) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Created schema index Bridge.name {{(pid=71285) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [POLLOUT] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:18:59 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpjrnzgrwo/privsep.sock']
Apr 13 20:18:59 user sudo[80073]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpjrnzgrwo/privsep.sock
Apr 13 20:18:59 user sudo[80073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-changed-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Refreshing instance network info cache due to event network-changed-647040e8-c10a-43ef-ae04-6be7319fae12. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Acquiring lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:18:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated VIF entry in instance network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-64cac746-4256-4d43-bc7f-eb30cd27fbd7 req-40512623-7dde-4808-8aef-841651e08b86 service nova] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:00 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Successfully created port: df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updating instance_info_cache with network_info: [{"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Releasing lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Instance network_info: |[{"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Acquired lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Refreshing network info cache for port 647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Start _get_guest_xml network_info=[{"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-763294771',display_name='tempest-DeleteServersTestJSON-server-763294771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-763294771',id=2,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da6301bd811748429fd4bc6b1205e07d',ramdisk_id='',reservation_id='r-bipmtg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-537831244',owner_user_name='tempest-DeleteServersTestJSON-537831244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:54Z,user_data=None,user_id='b50309fc4b92451f8cc40e92b10861ba',uuid=b6fde0f5-70fc-49a5-96f9-b67ed1662a10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converting VIF {"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.objects.instance [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lazy-loading 'pci_devices' on Instance uuid b6fde0f5-70fc-49a5-96f9-b67ed1662a10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:01 user nova-compute[71285]:   <uuid>b6fde0f5-70fc-49a5-96f9-b67ed1662a10</uuid>
Apr 13 20:19:01 user nova-compute[71285]:   <name>instance-00000002</name>
Apr 13 20:19:01 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:01 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:01 user nova-compute[71285]:   <metadata>
Apr 13 20:19:01 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:01 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:name>tempest-DeleteServersTestJSON-server-763294771</nova:name>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:01</nova:creationTime>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:01 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:01 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:user uuid="b50309fc4b92451f8cc40e92b10861ba">tempest-DeleteServersTestJSON-537831244-project-member</nova:user>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:project uuid="da6301bd811748429fd4bc6b1205e07d">tempest-DeleteServersTestJSON-537831244</nova:project>
Apr 13 20:19:01 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:19:01 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:01 user nova-compute[71285]:         <nova:port uuid="647040e8-c10a-43ef-ae04-6be7319fae12">
Apr 13 20:19:01 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 20:19:01 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:01 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:01 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:01 user nova-compute[71285]:   </metadata>
Apr 13 20:19:01 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:01 user nova-compute[71285]:     <system>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="serial">b6fde0f5-70fc-49a5-96f9-b67ed1662a10</entry>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="uuid">b6fde0f5-70fc-49a5-96f9-b67ed1662a10</entry>
Apr 13 20:19:01 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:01 user nova-compute[71285]:     </system>
Apr 13 20:19:01 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:01 user nova-compute[71285]:   <os>
Apr 13 20:19:01 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:01 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:01 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:01 user nova-compute[71285]:   </os>
Apr 13 20:19:01 user nova-compute[71285]:   <features>
Apr 13 20:19:01 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:01 user nova-compute[71285]:     <apic/>
Apr 13 20:19:01 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:01 user nova-compute[71285]:   </features>
Apr 13 20:19:01 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:01 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:01 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:01 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:01 user nova-compute[71285]:   </clock>
Apr 13 20:19:01 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:01 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:01 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:01 user nova-compute[71285]:   </cpu>
Apr 13 20:19:01 user nova-compute[71285]:   <devices>
Apr 13 20:19:01 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:01 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:01 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk"/>
Apr 13 20:19:01 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:19:01 user nova-compute[71285]:     </disk>
Apr 13 20:19:01 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:01 user nova-compute[71285]:       <mac address="fa:16:3e:41:fe:20"/>
Apr 13 20:19:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:01 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:01 user nova-compute[71285]:       <target dev="tap647040e8-c1"/>
Apr 13 20:19:01 user nova-compute[71285]:     </interface>
Apr 13 20:19:01 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:01 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/console.log" append="off"/>
Apr 13 20:19:01 user nova-compute[71285]:     </serial>
Apr 13 20:19:01 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:01 user nova-compute[71285]:     <video>
Apr 13 20:19:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:01 user nova-compute[71285]:     </video>
Apr 13 20:19:01 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:01 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:01 user nova-compute[71285]:     </rng>
Apr 13 20:19:01 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:01 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:01 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:01 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:01 user nova-compute[71285]:   </devices>
Apr 13 20:19:01 user nova-compute[71285]: </domain>
Apr 13 20:19:01 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-763294771',display_name='tempest-DeleteServersTestJSON-server-763294771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-763294771',id=2,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da6301bd811748429fd4bc6b1205e07d',ramdisk_id='',reservation_id='r-bipmtg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-537831244',owner_user_name='tempest-DeleteServersTestJSON-537831244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:54Z,user_data=None,user_id='b50309fc4b92451f8cc40e92b10861ba',uuid=b6fde0f5-70fc-49a5-96f9-b67ed1662a10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converting VIF {"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG os_vif [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:01 user sudo[80073]: pam_unix(sudo:session): session closed for user root
Apr 13 20:19:01 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Spawned new privsep daemon via rootwrap
Apr 13 20:19:01 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 20:19:01 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 20:19:01 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 13 20:19:01 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80078
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: WARNING oslo_privsep.priv_context [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] privsep daemon already running
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap647040e8-c1, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap647040e8-c1, col_values=(('external_ids', {'iface-id': '647040e8-c10a-43ef-ae04-6be7319fae12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:fe:20', 'vm-uuid': 'b6fde0f5-70fc-49a5-96f9-b67ed1662a10'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: INFO os_vif [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1')
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55d65e58-cf, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55d65e58-cf, col_values=(('external_ids', {'iface-id': '55d65e58-cf52-4044-a5c3-b7d5c4bf4bad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:e5:44', 'vm-uuid': '54d25a51-cd3f-4ea1-9de4-66de37fcb476'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:02 user nova-compute[71285]: INFO os_vif [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf')
Apr 13 20:19:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] No VIF found with MAC fa:16:3e:41:fe:20, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No VIF found with MAC fa:16:3e:06:e5:44, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updated VIF entry in instance network info cache for port 647040e8-c10a-43ef-ae04-6be7319fae12. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updating instance_info_cache with network_info: [{"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df2e4e08-3b62-4e21-a20b-0e437a78b735 req-27a2ed03-1257-48a4-9ddc-b163b4f981a3 service nova] Releasing lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Successfully updated port: df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:19:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing instance network info cache due to event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance network_info: |[{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start _get_guest_xml network_info=[{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQLEfnUAdwXiipQWQC6KVFeB1qTwUX2x1/w1l3Smwk+oocpgJJtYwCafCK7wWtX/jdQXFNg9495lZCIwIq0anujj/KJcgFvWh54vZk//EcBX7yDONmBSz2eGEsOBPB1w==',key_name='tempest-keypair-1146136459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:06 user nova-compute[71285]:   <uuid>2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</uuid>
Apr 13 20:19:06 user nova-compute[71285]:   <name>instance-00000003</name>
Apr 13 20:19:06 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:06 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:06 user nova-compute[71285]:   <metadata>
Apr 13 20:19:06 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:06 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2122692990</nova:name>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:06</nova:creationTime>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:06 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:06 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:user uuid="36e11efc98604eb7a8d5b95563431e45">tempest-AttachVolumeShelveTestJSON-160294736-project-member</nova:user>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:project uuid="405aed9fca044ab39eabe188942230d2">tempest-AttachVolumeShelveTestJSON-160294736</nova:project>
Apr 13 20:19:06 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:19:06 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:06 user nova-compute[71285]:         <nova:port uuid="df3a82f9-8c19-424c-a1b3-3332149ac690">
Apr 13 20:19:06 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:19:06 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:06 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:06 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:06 user nova-compute[71285]:   </metadata>
Apr 13 20:19:06 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:06 user nova-compute[71285]:     <system>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="serial">2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</entry>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="uuid">2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</entry>
Apr 13 20:19:06 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:06 user nova-compute[71285]:     </system>
Apr 13 20:19:06 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:06 user nova-compute[71285]:   <os>
Apr 13 20:19:06 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:06 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:06 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:06 user nova-compute[71285]:   </os>
Apr 13 20:19:06 user nova-compute[71285]:   <features>
Apr 13 20:19:06 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:06 user nova-compute[71285]:     <apic/>
Apr 13 20:19:06 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:06 user nova-compute[71285]:   </features>
Apr 13 20:19:06 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:06 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:06 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:06 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:06 user nova-compute[71285]:   </clock>
Apr 13 20:19:06 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:06 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:06 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:06 user nova-compute[71285]:   </cpu>
Apr 13 20:19:06 user nova-compute[71285]:   <devices>
Apr 13 20:19:06 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:06 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:06 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk"/>
Apr 13 20:19:06 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:19:06 user nova-compute[71285]:     </disk>
Apr 13 20:19:06 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:06 user nova-compute[71285]:       <mac address="fa:16:3e:a6:7e:d3"/>
Apr 13 20:19:06 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:06 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:06 user nova-compute[71285]:       <target dev="tapdf3a82f9-8c"/>
Apr 13 20:19:06 user nova-compute[71285]:     </interface>
Apr 13 20:19:06 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:06 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/console.log" append="off"/>
Apr 13 20:19:06 user nova-compute[71285]:     </serial>
Apr 13 20:19:06 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:06 user nova-compute[71285]:     <video>
Apr 13 20:19:06 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:06 user nova-compute[71285]:     </video>
Apr 13 20:19:06 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:06 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:06 user nova-compute[71285]:     </rng>
Apr 13 20:19:06 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:06 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:06 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:06 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:06 user nova-compute[71285]:   </devices>
Apr 13 20:19:06 user nova-compute[71285]: </domain>
Apr 13 20:19:06 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQLEfnUAdwXiipQWQC6KVFeB1qTwUX2x1/w1l3Smwk+oocpgJJtYwCafCK7wWtX/jdQXFNg9495lZCIwIq0anujj/KJcgFvWh54vZk//EcBX7yDONmBSz2eGEsOBPB1w==',key_name='tempest-keypair-1146136459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:18:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG os_vif [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf3a82f9-8c, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf3a82f9-8c, col_values=(('external_ids', {'iface-id': 'df3a82f9-8c19-424c-a1b3-3332149ac690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:7e:d3', 'vm-uuid': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:06 user nova-compute[71285]: INFO os_vif [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c')
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No VIF found with MAC fa:16:3e:a6:7e:d3, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417146.879702, b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] VM Resumed (Lifecycle Event)
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:06 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Instance spawned successfully.
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance spawned successfully.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417146.8811502, b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] VM Started (Lifecycle Event)
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Took 13.39 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Took 14.04 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417147.0155394, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Resumed (Lifecycle Event)
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Took 14.71 seconds to build instance.
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417147.0188549, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Started (Lifecycle Event)
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-aa1f4226-6011-4a1b-8889-ffe27ac326a6 tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.952s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:07 user nova-compute[71285]: INFO nova.compute.manager [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Took 15.13 seconds to build instance.
Apr 13 20:19:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-40107532-69c1-4bed-a867-c128c95a36d8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.370s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updated VIF entry in instance network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54041106-00c2-4f7d-9dfe-8b3096a04315 req-a523fda9-a071-47c4-bdff-b2a0c80bda8e service nova] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:09 user nova-compute[71285]: WARNING nova.compute.manager [req-01085d49-6ae3-423c-9b5c-773f9fedee59 req-e30ffbaa-0381-4045-bf41-dceda15e7619 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state building and task_state spawning.
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] No waiting events found dispatching network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:09 user nova-compute[71285]: WARNING nova.compute.manager [req-1ce3b030-d948-4e7f-b87b-c7befa68ab76 req-9047283c-e702-43cb-b6d1-10a4306ced0c service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received unexpected event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 for instance with vm_state active and task_state None.
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:10 user nova-compute[71285]: INFO nova.compute.claims [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Claim successful on node user
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:10 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:19:10 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Creating image(s)
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "/opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "/opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "/opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.policy [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.252s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417151.2557054, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Resumed (Lifecycle Event)
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance spawned successfully.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417151.2564924, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Started (Lifecycle Event)
Apr 13 20:19:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.241s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Took 13.80 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk 1073741824" returned: 0 in 0.090s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:11 user nova-compute[71285]: WARNING nova.compute.manager [req-c081bcd3-6e7a-40ed-aa94-e7252b229ae3 req-28b34117-927a-4a8a-a410-90773bba48e9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state building and task_state spawning.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.266s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:11 user nova-compute[71285]: INFO nova.compute.manager [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Took 14.75 seconds to build instance.
Apr 13 20:19:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4564104d-2821-413c-9bf3-8c264f9c87a7 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.905s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Cannot resize image /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'migration_context' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Ensure instance console log exists: /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] No waiting events found dispatching network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:12 user nova-compute[71285]: WARNING nova.compute.manager [req-3ddc3b74-f0f3-48d9-bb1f-0928742b5775 req-f2df2b9f-24c2-4d65-8ae0-13a74d90f6df service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received unexpected event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 for instance with vm_state active and task_state None.
Apr 13 20:19:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:14 user nova-compute[71285]: WARNING nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state None.
Apr 13 20:19:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:14 user nova-compute[71285]: WARNING nova.compute.manager [req-4593fbed-228b-465f-8338-d594b51dd2a9 req-e77d2ffe-fb43-4d6f-9aba-aee923f5fb51 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state None.
Apr 13 20:19:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Successfully created port: 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Successfully updated port: 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquired lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-changed-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Refreshing instance network info cache due to event network-changed-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Acquiring lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating instance_info_cache with network_info: [{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Releasing lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Instance network_info: |[{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Acquired lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.neutron [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Refreshing network info cache for port 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Start _get_guest_xml network_info=[{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1689071346',display_name='tempest-VolumesAdminNegativeTest-server-1689071346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1689071346',id=4,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMR5psfAcnJlKjT/RtzaTkF3/qOYyDj5Xn6kIK/NUuAwGleXA15sRvKayZlO18tYgwanamPIT8ZggDbnda9sBlIc1tFLCti7muSZvOgdDdZfdJxmASXXhL821fWkXkfIg==',key_name='tempest-keypair-2052829447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-voi0okh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cbfa14567af452db21cb0022514773b',uuid=0136288f-abaf-4a7c-a878-db415ff98f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'pci_devices' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:18 user nova-compute[71285]:   <uuid>0136288f-abaf-4a7c-a878-db415ff98f4b</uuid>
Apr 13 20:19:18 user nova-compute[71285]:   <name>instance-00000004</name>
Apr 13 20:19:18 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:18 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:18 user nova-compute[71285]:   <metadata>
Apr 13 20:19:18 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:18 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1689071346</nova:name>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:17</nova:creationTime>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:18 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:18 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:user uuid="7cbfa14567af452db21cb0022514773b">tempest-VolumesAdminNegativeTest-1573778134-project-member</nova:user>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:project uuid="41ed651e141447b995ccae680f1f3681">tempest-VolumesAdminNegativeTest-1573778134</nova:project>
Apr 13 20:19:18 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:19:18 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:18 user nova-compute[71285]:         <nova:port uuid="11b35baa-5ecc-4d79-ba64-fd5ab401d2b1">
Apr 13 20:19:18 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 20:19:18 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:18 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:18 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:18 user nova-compute[71285]:   </metadata>
Apr 13 20:19:18 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:18 user nova-compute[71285]:     <system>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="serial">0136288f-abaf-4a7c-a878-db415ff98f4b</entry>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="uuid">0136288f-abaf-4a7c-a878-db415ff98f4b</entry>
Apr 13 20:19:18 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:18 user nova-compute[71285]:     </system>
Apr 13 20:19:18 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:18 user nova-compute[71285]:   <os>
Apr 13 20:19:18 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:18 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:18 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:18 user nova-compute[71285]:   </os>
Apr 13 20:19:18 user nova-compute[71285]:   <features>
Apr 13 20:19:18 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:18 user nova-compute[71285]:     <apic/>
Apr 13 20:19:18 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:18 user nova-compute[71285]:   </features>
Apr 13 20:19:18 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:18 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:18 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:18 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:18 user nova-compute[71285]:   </clock>
Apr 13 20:19:18 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:18 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:18 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:18 user nova-compute[71285]:   </cpu>
Apr 13 20:19:18 user nova-compute[71285]:   <devices>
Apr 13 20:19:18 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:18 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:18 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk"/>
Apr 13 20:19:18 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:19:18 user nova-compute[71285]:     </disk>
Apr 13 20:19:18 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:18 user nova-compute[71285]:       <mac address="fa:16:3e:9b:45:0e"/>
Apr 13 20:19:18 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:18 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:18 user nova-compute[71285]:       <target dev="tap11b35baa-5e"/>
Apr 13 20:19:18 user nova-compute[71285]:     </interface>
Apr 13 20:19:18 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:18 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/console.log" append="off"/>
Apr 13 20:19:18 user nova-compute[71285]:     </serial>
Apr 13 20:19:18 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:18 user nova-compute[71285]:     <video>
Apr 13 20:19:18 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:18 user nova-compute[71285]:     </video>
Apr 13 20:19:18 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:18 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:18 user nova-compute[71285]:     </rng>
Apr 13 20:19:18 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:18 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:18 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:18 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:18 user nova-compute[71285]:   </devices>
Apr 13 20:19:18 user nova-compute[71285]: </domain>
Apr 13 20:19:18 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1689071346',display_name='tempest-VolumesAdminNegativeTest-server-1689071346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1689071346',id=4,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMR5psfAcnJlKjT/RtzaTkF3/qOYyDj5Xn6kIK/NUuAwGleXA15sRvKayZlO18tYgwanamPIT8ZggDbnda9sBlIc1tFLCti7muSZvOgdDdZfdJxmASXXhL821fWkXkfIg==',key_name='tempest-keypair-2052829447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-voi0okh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cbfa14567af452db21cb0022514773b',uuid=0136288f-abaf-4a7c-a878-db415ff98f4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG os_vif [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11b35baa-5e, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11b35baa-5e, col_values=(('external_ids', {'iface-id': '11b35baa-5ecc-4d79-ba64-fd5ab401d2b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:45:0e', 'vm-uuid': '0136288f-abaf-4a7c-a878-db415ff98f4b'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:18 user nova-compute[71285]: INFO os_vif [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e')
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No VIF found with MAC fa:16:3e:9b:45:0e, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updated VIF entry in instance network info cache for port 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating instance_info_cache with network_info: [{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-57c17210-ba74-47fa-9ec6-1203d675dccc req-4e5f5838-efc3-4efa-b4c1-26f47e5a3a98 service nova] Releasing lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:20 user nova-compute[71285]: INFO nova.compute.claims [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Claim successful on node user
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] No waiting events found dispatching network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:20 user nova-compute[71285]: WARNING nova.compute.manager [req-3c62acf1-0c67-4276-8146-14c47d0bcfc2 req-23665b47-8935-4f16-8e26-652e50d26559 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received unexpected event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance with vm_state building and task_state spawning.
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:20 user nova-compute[71285]: DEBUG nova.policy [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '195c6c0bc1ec4796b5c1e2ba88c7534a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49944b378c2b4e618a631771465a4a9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:19:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Creating image(s)
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "/opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "/opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "/opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.120s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.165s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk 1073741824" returned: 0 in 0.083s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.170s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Successfully created port: 3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Cannot resize image /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'migration_context' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Ensure instance console log exists: /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417162.4419332, 0136288f-abaf-4a7c-a878-db415ff98f4b => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] VM Resumed (Lifecycle Event)
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Instance spawned successfully.
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417162.446856, 0136288f-abaf-4a7c-a878-db415ff98f4b => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] VM Started (Lifecycle Event)
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] No waiting events found dispatching network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:22 user nova-compute[71285]: WARNING nova.compute.manager [req-1da82a46-159e-4cc9-a590-52c416e9f08e req-d1fe8346-d306-4ce1-9cf7-973621ea85b2 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received unexpected event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance with vm_state building and task_state spawning.
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.claims [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Claim successful on node user
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Took 11.86 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:22 user nova-compute[71285]: INFO nova.compute.manager [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Took 12.86 seconds to build instance.
Apr 13 20:19:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7cdc7c3-abbe-428d-822d-34987fcf44b1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.007s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Successfully updated port: 3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquired lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-changed-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Refreshing instance network info cache due to event network-changed-3e161dc0-b110-47f1-9a0a-f9add33a394b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Acquiring lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:19:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Creating image(s)
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.policy [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02540e30946f4e5c844c1e8f260e4728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2fff2eec2af433e9699cbc5be23e80e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.part --force-share --output=json" returned: 0 in 0.179s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.images [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] f1c9d799-549d-45fe-975d-6271934a1df9 was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.part /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.part /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.converted" returned: 0 in 0.178s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.848s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updating instance_info_cache with network_info: [{"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Releasing lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Instance network_info: |[{"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Acquired lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Refreshing network info cache for port 3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Start _get_guest_xml network_info=[{"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:24 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:24 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482198801',display_name='tempest-TestVolumeSwap-server-1482198801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482198801',id=5,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrwrPfleyNjl3pDB5OkN2SYvDCZ013r8+oGp8DrB4SN27ompGWdOkKmSpJhoB5cQCLOWrXxLcw6gtj75RcWJZ4DWqDRz9J0aW7xIy1OvV2R0hIUpHmgCErOlVkccauWWg==',key_name='tempest-keypair-1666630945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49944b378c2b4e618a631771465a4a9b',ramdisk_id='',reservation_id='r-sdldkxbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1264222431',owner_user_name='tempest-TestVolumeSwap-1264222431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195c6c0bc1ec4796b5c1e2ba88c7534a',uuid=da17669c-1ea2-450a-8183-40b47c4f41fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converting VIF {"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'pci_devices' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json" returned: 0 in 0.295s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:24 user nova-compute[71285]:   <uuid>da17669c-1ea2-450a-8183-40b47c4f41fc</uuid>
Apr 13 20:19:24 user nova-compute[71285]:   <name>instance-00000005</name>
Apr 13 20:19:24 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:24 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:24 user nova-compute[71285]:   <metadata>
Apr 13 20:19:24 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:24 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:name>tempest-TestVolumeSwap-server-1482198801</nova:name>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:24</nova:creationTime>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:24 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:24 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:user uuid="195c6c0bc1ec4796b5c1e2ba88c7534a">tempest-TestVolumeSwap-1264222431-project-member</nova:user>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:project uuid="49944b378c2b4e618a631771465a4a9b">tempest-TestVolumeSwap-1264222431</nova:project>
Apr 13 20:19:24 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:19:24 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:24 user nova-compute[71285]:         <nova:port uuid="3e161dc0-b110-47f1-9a0a-f9add33a394b">
Apr 13 20:19:24 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 20:19:24 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:24 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:24 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:24 user nova-compute[71285]:   </metadata>
Apr 13 20:19:24 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:24 user nova-compute[71285]:     <system>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="serial">da17669c-1ea2-450a-8183-40b47c4f41fc</entry>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="uuid">da17669c-1ea2-450a-8183-40b47c4f41fc</entry>
Apr 13 20:19:24 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:24 user nova-compute[71285]:     </system>
Apr 13 20:19:24 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:24 user nova-compute[71285]:   <os>
Apr 13 20:19:24 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:24 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:24 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:24 user nova-compute[71285]:   </os>
Apr 13 20:19:24 user nova-compute[71285]:   <features>
Apr 13 20:19:24 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:24 user nova-compute[71285]:     <apic/>
Apr 13 20:19:24 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:24 user nova-compute[71285]:   </features>
Apr 13 20:19:24 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:24 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:24 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:24 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:24 user nova-compute[71285]:   </clock>
Apr 13 20:19:24 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:24 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:24 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:24 user nova-compute[71285]:   </cpu>
Apr 13 20:19:24 user nova-compute[71285]:   <devices>
Apr 13 20:19:24 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:24 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:24 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk"/>
Apr 13 20:19:24 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:19:24 user nova-compute[71285]:     </disk>
Apr 13 20:19:24 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:24 user nova-compute[71285]:       <mac address="fa:16:3e:e4:c4:8f"/>
Apr 13 20:19:24 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:24 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:24 user nova-compute[71285]:       <target dev="tap3e161dc0-b1"/>
Apr 13 20:19:24 user nova-compute[71285]:     </interface>
Apr 13 20:19:24 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:24 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/console.log" append="off"/>
Apr 13 20:19:24 user nova-compute[71285]:     </serial>
Apr 13 20:19:24 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:24 user nova-compute[71285]:     <video>
Apr 13 20:19:24 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:24 user nova-compute[71285]:     </video>
Apr 13 20:19:24 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:24 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:24 user nova-compute[71285]:     </rng>
Apr 13 20:19:24 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:24 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:24 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:24 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:24 user nova-compute[71285]:   </devices>
Apr 13 20:19:24 user nova-compute[71285]: </domain>
Apr 13 20:19:24 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482198801',display_name='tempest-TestVolumeSwap-server-1482198801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482198801',id=5,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrwrPfleyNjl3pDB5OkN2SYvDCZ013r8+oGp8DrB4SN27ompGWdOkKmSpJhoB5cQCLOWrXxLcw6gtj75RcWJZ4DWqDRz9J0aW7xIy1OvV2R0hIUpHmgCErOlVkccauWWg==',key_name='tempest-keypair-1666630945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49944b378c2b4e618a631771465a4a9b',ramdisk_id='',reservation_id='r-sdldkxbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1264222431',owner_user_name='tempest-TestVolumeSwap-1264222431-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195c6c0bc1ec4796b5c1e2ba88c7534a',uuid=da17669c-1ea2-450a-8183-40b47c4f41fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converting VIF {"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG os_vif [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e161dc0-b1, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e161dc0-b1, col_values=(('external_ids', {'iface-id': '3e161dc0-b110-47f1-9a0a-f9add33a394b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:c4:8f', 'vm-uuid': 'da17669c-1ea2-450a-8183-40b47c4f41fc'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:24 user nova-compute[71285]: INFO os_vif [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1')
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json" returned: 0 in 0.166s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c,backing_fmt=raw /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c,backing_fmt=raw /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk 1073741824" returned: 0 in 0.059s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "b3c148e9b5b7ca5037c016fa22690e5b0983407c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] No VIF found with MAC fa:16:3e:e4:c4:8f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c --force-share --output=json" returned: 0 in 0.188s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Successfully created port: 80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Cannot resize image /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'migration_context' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Ensure instance console log exists: /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updated VIF entry in instance network info cache for port 3e161dc0-b110-47f1-9a0a-f9add33a394b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updating instance_info_cache with network_info: [{"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cf1f5c4-4ba9-4766-8f2c-11cdf180aa45 req-e8608807-4f37-489b-82dd-ab285578e702 service nova] Releasing lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:25 user nova-compute[71285]: INFO nova.compute.claims [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Claim successful on node user
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Successfully updated port: 80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquired lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-changed-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Refreshing instance network info cache due to event network-changed-80e7738a-fc24-4b82-b70b-ae85ea74545f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Acquiring lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating instance_info_cache with network_info: [{"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:26 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Releasing lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Instance network_info: |[{"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Acquired lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.neutron [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Refreshing network info cache for port 80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Start _get_guest_xml network_info=[{"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:19:14Z,direct_url=<?>,disk_format='qcow2',id=f1c9d799-549d-45fe-975d-6271934a1df9,min_disk=0,min_ram=0,name='',owner='330f3cca3dac40babdb9a312753db7b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:19:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_name': '/dev/sda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'scsi', 'image_id': 'f1c9d799-549d-45fe-975d-6271934a1df9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.150s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:27 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:27 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:19:14Z,direct_url=<?>,disk_format='qcow2',id=f1c9d799-549d-45fe-975d-6271934a1df9,min_disk=0,min_ram=0,name='',owner='330f3cca3dac40babdb9a312753db7b6',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:19:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-569327851',display_name='tempest-AttachSCSIVolumeTestJSON-server-569327851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-569327851',id=6,image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUdmP1CY8bdTh8IXDrsiI4+sMDfwgwwFraKNk8459+0r49Q9ABneRe4MPsuQ/EiitrvDfvuzfptfBBU8iwJnxppZYB6l8MvGtaZ90NTqGXOPbE8oGQStKt+DK5t1pV+Hg==',key_name='tempest-keypair-964773546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fff2eec2af433e9699cbc5be23e80e',ramdisk_id='',reservation_id='r-0y9mgp1n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1525127673',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1525127673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02540e30946f4e5c844c1e8f260e4728',uuid=c936eb14-b16e-46fb-9e39-5ba49da4fb73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converting VIF {"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'pci_devices' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:27 user nova-compute[71285]:   <uuid>c936eb14-b16e-46fb-9e39-5ba49da4fb73</uuid>
Apr 13 20:19:27 user nova-compute[71285]:   <name>instance-00000006</name>
Apr 13 20:19:27 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:27 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:27 user nova-compute[71285]:   <metadata>
Apr 13 20:19:27 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:27 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-569327851</nova:name>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:27</nova:creationTime>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:27 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:27 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:user uuid="02540e30946f4e5c844c1e8f260e4728">tempest-AttachSCSIVolumeTestJSON-1525127673-project-member</nova:user>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:project uuid="a2fff2eec2af433e9699cbc5be23e80e">tempest-AttachSCSIVolumeTestJSON-1525127673</nova:project>
Apr 13 20:19:27 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:root type="image" uuid="f1c9d799-549d-45fe-975d-6271934a1df9"/>
Apr 13 20:19:27 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:27 user nova-compute[71285]:         <nova:port uuid="80e7738a-fc24-4b82-b70b-ae85ea74545f">
Apr 13 20:19:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 20:19:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:27 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:27 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:27 user nova-compute[71285]:   </metadata>
Apr 13 20:19:27 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:27 user nova-compute[71285]:     <system>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="serial">c936eb14-b16e-46fb-9e39-5ba49da4fb73</entry>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="uuid">c936eb14-b16e-46fb-9e39-5ba49da4fb73</entry>
Apr 13 20:19:27 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:27 user nova-compute[71285]:     </system>
Apr 13 20:19:27 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:27 user nova-compute[71285]:   <os>
Apr 13 20:19:27 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:27 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:27 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:27 user nova-compute[71285]:   </os>
Apr 13 20:19:27 user nova-compute[71285]:   <features>
Apr 13 20:19:27 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:27 user nova-compute[71285]:     <apic/>
Apr 13 20:19:27 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:27 user nova-compute[71285]:   </features>
Apr 13 20:19:27 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:27 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:27 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:27 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:27 user nova-compute[71285]:   </clock>
Apr 13 20:19:27 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:27 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:27 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:27 user nova-compute[71285]:   </cpu>
Apr 13 20:19:27 user nova-compute[71285]:   <devices>
Apr 13 20:19:27 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:27 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:27 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk"/>
Apr 13 20:19:27 user nova-compute[71285]:       <target dev="sda" bus="scsi"/>
Apr 13 20:19:27 user nova-compute[71285]:       <address type="drive" controller="0" unit="0"/>
Apr 13 20:19:27 user nova-compute[71285]:     </disk>
Apr 13 20:19:27 user nova-compute[71285]:     <disk type="file" device="cdrom">
Apr 13 20:19:27 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 20:19:27 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.config"/>
Apr 13 20:19:27 user nova-compute[71285]:       <target dev="sdb" bus="scsi"/>
Apr 13 20:19:27 user nova-compute[71285]:       <address type="drive" controller="0" unit="1"/>
Apr 13 20:19:27 user nova-compute[71285]:     </disk>
Apr 13 20:19:27 user nova-compute[71285]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 13 20:19:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:27 user nova-compute[71285]:       <mac address="fa:16:3e:99:9b:cb"/>
Apr 13 20:19:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:27 user nova-compute[71285]:       <target dev="tap80e7738a-fc"/>
Apr 13 20:19:27 user nova-compute[71285]:     </interface>
Apr 13 20:19:27 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:27 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/console.log" append="off"/>
Apr 13 20:19:27 user nova-compute[71285]:     </serial>
Apr 13 20:19:27 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:27 user nova-compute[71285]:     <video>
Apr 13 20:19:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:27 user nova-compute[71285]:     </video>
Apr 13 20:19:27 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:27 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:27 user nova-compute[71285]:     </rng>
Apr 13 20:19:27 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:27 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:27 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:27 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:27 user nova-compute[71285]:   </devices>
Apr 13 20:19:27 user nova-compute[71285]: </domain>
Apr 13 20:19:27 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-569327851',display_name='tempest-AttachSCSIVolumeTestJSON-server-569327851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-569327851',id=6,image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUdmP1CY8bdTh8IXDrsiI4+sMDfwgwwFraKNk8459+0r49Q9ABneRe4MPsuQ/EiitrvDfvuzfptfBBU8iwJnxppZYB6l8MvGtaZ90NTqGXOPbE8oGQStKt+DK5t1pV+Hg==',key_name='tempest-keypair-964773546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2fff2eec2af433e9699cbc5be23e80e',ramdisk_id='',reservation_id='r-0y9mgp1n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1525127673',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1525127673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02540e30946f4e5c844c1e8f260e4728',uuid=c936eb14-b16e-46fb-9e39-5ba49da4fb73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converting VIF {"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG os_vif [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80e7738a-fc, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80e7738a-fc, col_values=(('external_ids', {'iface-id': '80e7738a-fc24-4b82-b70b-ae85ea74545f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:9b:cb', 'vm-uuid': 'c936eb14-b16e-46fb-9e39-5ba49da4fb73'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: INFO os_vif [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc')
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No BDM found with device name sda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No VIF found with MAC fa:16:3e:99:9b:cb, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Using config drive
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:19:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Creating image(s)
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Creating config drive at /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.config
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5bjfrm56 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5bjfrm56" returned: 0 in 0.061s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG nova.policy [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.206s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk 1073741824" returned: 0 in 0.059s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Cannot resize image /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.objects.instance [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'migration_context' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Ensure instance console log exists: /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] No waiting events found dispatching network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:28 user nova-compute[71285]: WARNING nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received unexpected event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b for instance with vm_state building and task_state spawning.
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] No waiting events found dispatching network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:28 user nova-compute[71285]: WARNING nova.compute.manager [req-dff9cf0a-46b0-4a15-8e6c-fbae68daa326 req-d0376bf1-d4c9-4450-8128-a267245ff650 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received unexpected event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b for instance with vm_state building and task_state spawning.
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.network.neutron [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updated VIF entry in instance network info cache for port 80e7738a-fc24-4b82-b70b-ae85ea74545f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.network.neutron [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating instance_info_cache with network_info: [{"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-003357e7-74f3-4452-ad4d-f453afd666e5 req-c418827c-63ca-49e0-898b-eb1f0dc60207 service nova] Releasing lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Successfully created port: 3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] No waiting events found dispatching network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:29 user nova-compute[71285]: WARNING nova.compute.manager [req-42d38a1b-539b-4bee-98c3-2a413c452631 req-cd7eaff2-4bd7-498d-a1b9-d133de75050d service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received unexpected event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f for instance with vm_state building and task_state spawning.
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417169.6983747, da17669c-1ea2-450a-8183-40b47c4f41fc => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] VM Resumed (Lifecycle Event)
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Instance spawned successfully.
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Successfully updated port: 3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417169.6993217, da17669c-1ea2-450a-8183-40b47c4f41fc => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] VM Started (Lifecycle Event)
Apr 13 20:19:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Took 8.79 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:30 user nova-compute[71285]: INFO nova.compute.manager [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Took 10.09 seconds to build instance.
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2208b97b-df4d-4892-8a67-a96c09fde21b tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.315s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Instance network_info: |[{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Start _get_guest_xml network_info=[{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:19:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'pci_devices' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:19:30 user nova-compute[71285]:   <uuid>a78111f4-fcd5-4efc-977e-d8d32225c83f</uuid>
Apr 13 20:19:30 user nova-compute[71285]:   <name>instance-00000007</name>
Apr 13 20:19:30 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:19:30 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:19:30 user nova-compute[71285]:   <metadata>
Apr 13 20:19:30 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:19:30 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:19:30</nova:creationTime>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:19:30 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:19:30 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:owner>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:19:30 user nova-compute[71285]:       </nova:owner>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:19:30 user nova-compute[71285]:       <nova:ports>
Apr 13 20:19:30 user nova-compute[71285]:         <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:19:30 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:19:30 user nova-compute[71285]:         </nova:port>
Apr 13 20:19:30 user nova-compute[71285]:       </nova:ports>
Apr 13 20:19:30 user nova-compute[71285]:     </nova:instance>
Apr 13 20:19:30 user nova-compute[71285]:   </metadata>
Apr 13 20:19:30 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:19:30 user nova-compute[71285]:     <system>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="serial">a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="uuid">a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:19:30 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:19:30 user nova-compute[71285]:     </system>
Apr 13 20:19:30 user nova-compute[71285]:   </sysinfo>
Apr 13 20:19:30 user nova-compute[71285]:   <os>
Apr 13 20:19:30 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:19:30 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:19:30 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:19:30 user nova-compute[71285]:   </os>
Apr 13 20:19:30 user nova-compute[71285]:   <features>
Apr 13 20:19:30 user nova-compute[71285]:     <acpi/>
Apr 13 20:19:30 user nova-compute[71285]:     <apic/>
Apr 13 20:19:30 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:19:30 user nova-compute[71285]:   </features>
Apr 13 20:19:30 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:19:30 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:19:30 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:19:30 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:19:30 user nova-compute[71285]:   </clock>
Apr 13 20:19:30 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:19:30 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:19:30 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:19:30 user nova-compute[71285]:   </cpu>
Apr 13 20:19:30 user nova-compute[71285]:   <devices>
Apr 13 20:19:30 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:19:30 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:19:30 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk"/>
Apr 13 20:19:30 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:19:30 user nova-compute[71285]:     </disk>
Apr 13 20:19:30 user nova-compute[71285]:     <disk type="file" device="cdrom">
Apr 13 20:19:30 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 20:19:30 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config"/>
Apr 13 20:19:30 user nova-compute[71285]:       <target dev="hda" bus="ide"/>
Apr 13 20:19:30 user nova-compute[71285]:     </disk>
Apr 13 20:19:30 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:19:30 user nova-compute[71285]:       <mac address="fa:16:3e:0c:9f:f0"/>
Apr 13 20:19:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:30 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:19:30 user nova-compute[71285]:       <target dev="tap3ac07688-57"/>
Apr 13 20:19:30 user nova-compute[71285]:     </interface>
Apr 13 20:19:30 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:19:30 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log" append="off"/>
Apr 13 20:19:30 user nova-compute[71285]:     </serial>
Apr 13 20:19:30 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:19:30 user nova-compute[71285]:     <video>
Apr 13 20:19:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:19:30 user nova-compute[71285]:     </video>
Apr 13 20:19:30 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:19:30 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:19:30 user nova-compute[71285]:     </rng>
Apr 13 20:19:30 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:19:30 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:19:30 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:19:30 user nova-compute[71285]:     </memballoon>
Apr 13 20:19:30 user nova-compute[71285]:   </devices>
Apr 13 20:19:30 user nova-compute[71285]: </domain>
Apr 13 20:19:30 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG os_vif [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ac07688-57, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ac07688-57, col_values=(('external_ids', {'iface-id': '3ac07688-57a6-45c2-9b2c-eea32bc1e446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:9f:f0', 'vm-uuid': 'a78111f4-fcd5-4efc-977e-d8d32225c83f'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:30 user nova-compute[71285]: INFO os_vif [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57')
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name hda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No VIF found with MAC fa:16:3e:0c:9f:f0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:19:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Using config drive
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-changed-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing instance network info cache due to event network-changed-3ac07688-57a6-45c2-9b2c-eea32bc1e446. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG nova.network.neutron [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing network info cache for port 3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Creating config drive at /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_70jt7yh {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_70jt7yh" returned: 0 in 0.058s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updated VIF entry in instance network info cache for port 3ac07688-57a6-45c2-9b2c-eea32bc1e446. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-aa952f59-647b-423c-be9e-4b5693fd4a10 req-96a7abc8-ae4e-4180-8b68-052036e88050 service nova] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] No waiting events found dispatching network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:31 user nova-compute[71285]: WARNING nova.compute.manager [req-1fa7d037-d030-437b-b417-b42b45e4940b req-d9f14743-a3bd-4709-81ef-6b997ad42d19 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received unexpected event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f for instance with vm_state building and task_state spawning.
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417171.7553535, c936eb14-b16e-46fb-9e39-5ba49da4fb73 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:31 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] VM Resumed (Lifecycle Event)
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Instance spawned successfully.
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:31 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417171.7683651, c936eb14-b16e-46fb-9e39-5ba49da4fb73 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:31 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] VM Started (Lifecycle Event)
Apr 13 20:19:31 user nova-compute[71285]: INFO nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Took 8.32 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:32 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:32 user nova-compute[71285]: INFO nova.compute.manager [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Took 9.57 seconds to build instance.
Apr 13 20:19:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1e479bf7-4629-44d6-a4e3-709506dd316a tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.741s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:33 user nova-compute[71285]: WARNING nova.compute.manager [req-242336da-554e-42be-b80c-7627355297cd req-98a63611-a8f1-4e17-b98b-7f9b215e14a6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance with vm_state building and task_state spawning.
Apr 13 20:19:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:19:35 user nova-compute[71285]: WARNING nova.compute.manager [req-a5809d3c-39c6-4fc5-860e-cbb16aed3b4d req-2cb27c5b-3bcb-49b3-a8c5-31c26eaa1176 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance with vm_state building and task_state spawning.
Apr 13 20:19:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417175.3998706, a78111f4-fcd5-4efc-977e-d8d32225c83f => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] VM Resumed (Lifecycle Event)
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Instance spawned successfully.
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417175.4131238, a78111f4-fcd5-4efc-977e-d8d32225c83f => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] VM Started (Lifecycle Event)
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Took 8.13 seconds to spawn the instance on the hypervisor.
Apr 13 20:19:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:19:35 user nova-compute[71285]: INFO nova.compute.manager [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Took 9.88 seconds to build instance.
Apr 13 20:19:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58a32c4d-3826-4429-b9ff-c4e2ee914a47 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.024s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:19:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:45 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:45 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:19:45 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=26.760120391845703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance da17669c-1ea2-450a-8183-40b47c4f41fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a78111f4-fcd5-4efc-977e-d8d32225c83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:19:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.786s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:52 user nova-compute[71285]: INFO nova.compute.claims [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Claim successful on node user
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:52 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:52 user nova-compute[71285]: INFO nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Booting with volume b2979586-cf14-4797-b906-547f3363090c at /dev/vda
Apr 13 20:19:52 user nova-compute[71285]: DEBUG nova.policy [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dc7db2b4cb64d2e9ad08692b248bb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ced32cd96594324b6b8792ef56e28c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:52 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:19:52 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9ogbx0wc/privsep.sock']
Apr 13 20:19:52 user sudo[81280]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9ogbx0wc/privsep.sock
Apr 13 20:19:52 user sudo[81280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 13 20:19:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully created port: b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully created port: 0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:19:54 user nova-compute[71285]: INFO nova.compute.claims [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Claim successful on node user
Apr 13 20:19:54 user sudo[81280]: pam_unix(sudo:session): session closed for user root
Apr 13 20:19:54 user nova-compute[71285]: INFO oslo.privsep.daemon [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Spawned new privsep daemon via rootwrap
Apr 13 20:19:54 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 13 20:19:54 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 13 20:19:54 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 13 20:19:54 user nova-compute[71285]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81283
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8180010b-bdb2-4df6-82bb-d8ba58e0c114]: (2,) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aba97b-6dba-41fb-8c1b-2c32f9c08121]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: WARNING os_brick.initiator.connectors.nvmeof [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully created port: ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e6e0ab-be58-469f-b8ed-ae4864c7df44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d90c4-e180-4dac-b40d-d1a89065db40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dcb70f-ef3d-4ac7-a3f1-f36e31e1e135]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:19:55 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:19:55 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed92c0cf-0c36-4bed-8b0f-61dd56cf5727]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== get_connector_properties: return (2372ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating existing volume attachment record: bdf3345f-995b-47ce-a605-51d3d7777fa5 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:19:55 user nova-compute[71285]: INFO nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Booting with volume 09705428-be59-4d47-8c48-3f7a0d94963a at /dev/vda
Apr 13 20:19:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa8148a-7a71-418e-80ee-a14536de81e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a1ed6a-60b4-450d-b9b8-651ca24bbdc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62983ac2-71c2-4bca-8dfd-d7003337b254]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe3974-1588-4b9f-b4e5-64ca539fc9df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:19:55 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:19:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e425e72-a364-469f-be61-1c366d17abae]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating existing volume attachment record: a4ab5580-781f-4df7-b461-24f8a64e5673 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:19:55 user nova-compute[71285]: DEBUG nova.policy [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a2f99d6d3ee4f1b968dcc6ed6fccb84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e01e2122799d4cfe81a642146f5c1421', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:19:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:19:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully created port: b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully created port: 8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully created port: 68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully created port: 32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully created port: 12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-b2c1c646-b65c-4543-bf25-b89ff954fdd1. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:19:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0156f41-6075-4c69-ac44-92823230bccf req-c06e9c93-499b-4c3e-85e1-4b89f676cb2c service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:00 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: 58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:00 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully created port: 1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-58a1b4af-7470-4cef-8c7a-7e611f8942fb. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port 58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-58c5f224-bcf1-4b9c-8269-18c060015166 req-b522847d-2db0-4be4-9bab-ba440e2507b5 service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully created port: b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:20:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: 51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: 8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: 0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-51a691d6-af80-4126-9fa3-99fd3ee39a9d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port 51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-8a43e7e1-8da0-48b7-a18d-8899539118c7. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-0fc22c68-14c3-4803-952d-32dac032db89. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port 0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fbae8a2-f49c-4e66-9d90-7d843022dd56 req-9d77527e-b90b-41f1-85ea-9f40c3a2247b service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:04 user nova-compute[71285]: INFO nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Booting with volume f494b4ba-5741-4d3f-8eb1-b5ff89f54337 at /dev/vdb
Apr 13 20:20:04 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c58560-af8b-45e0-a556-1a1b4ebb15e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5de6a5b-2dbd-49e1-8d3b-77755a4cc44a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:04 user nova-compute[71285]: INFO nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Booting with volume ce955f5a-7ac3-40f7-ac14-f9c88130ab05 at /dev/vdb
Apr 13 20:20:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d671feb3-73f1-4afb-8df6-468e6a026ec5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe78c28-ad74-4467-91bd-c6fb6b2e9e96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:20:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:05 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[34525982-863d-460b-967c-aa7f2999aa10]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating existing volume attachment record: 1ea717d4-0f64-43cf-b8ff-b8b6e7a00f85 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bace7d2-81d2-47a1-bf75-3fcc0bbe816e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa9184-978c-4aee-ad47-48f55438b509]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a241909-9c9f-4c8b-9528-69c20435cf0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f3e54-fb3e-41e6-9281-4fd1ab80c1ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:05 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b2cfdb-df3a-4816-ae20-4e04c97bf844]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating existing volume attachment record: 12da5a07-10ca-4aaa-9750-353414f98f17 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-ee2ced5f-3757-4527-a93f-72d920a58291. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-cd297158-7c28-4e96-9055-7547d626d066. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: 4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a643474-7691-4b32-b333-1a870e4e9076 req-6c162540-eed8-43fd-90d1-348ee809121b service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Successfully updated port: 68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: 32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-b3deaefd-62cd-4147-b744-783c9f5ff678. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: 12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-12991ac8-5935-4b35-918a-015677766ea7. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:10 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: 1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ef840a85-cf59-4a17-a4cd-f7188aea908e req-4ce190e5-5670-4d86-aaa4-b9dbcf60adff service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance network_info: |[{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Successfully updated port: b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-b6c3e557-a7be-4d2a-bd41-1e48291a36cb. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updated VIF entry in instance network info cache for port b3deaefd-62cd-4147-b744-783c9f5ff678. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-4e89cf33-c25a-42d7-be8d-bfeeea25e607. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-1af834fc-094c-4fbc-a8fa-abf7d28cec5e. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:12 user nova-compute[71285]: INFO nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Booting with volume 400b6a69-9110-481d-89de-b9a4dad69bfa at /dev/vdc
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c6e5b-c2a9-4177-84ee-424cb9ebbcf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53a40f5-6adc-47dd-a718-b2583625d269]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0384d7-09c7-4105-bf19-c2aab3b54af4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d51952-55b4-4da3-8e4d-7976391675b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:12 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:20:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2691a-186a-4a21-880e-0ccfcdb965eb]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG os_brick.utils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:12 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating existing volume attachment record: b1d159ba-4a4e-4aed-963c-d64e2dae6480 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance network_info: |[{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updated VIF entry in instance network info cache for port b6c3e557-a7be-4d2a-bd41-1e48291a36cb. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e97e5d5-a6b0-4eb9-a02a-b9423f880e0e req-95e962f8-1f4d-4e65-beb2-46ea67e5e379 service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updated VIF entry in instance network info cache for port 4e89cf33-c25a-42d7-be8d-bfeeea25e607. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-68c624f1-a380-4397-b311-6104fad344a8. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port 68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updated VIF entry in instance network info cache for port 68c624f1-a380-4397-b311-6104fad344a8. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-32e1b953-1235-44ba-918c-ff264b484629. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updated VIF entry in instance network info cache for port 1af834fc-094c-4fbc-a8fa-abf7d28cec5e. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-70c7667b-f0bb-4811-81c5-0c70a0859830 req-fa684a3c-1931-4925-9ec6-809732db098d service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updated VIF entry in instance network info cache for port 32e1b953-1235-44ba-918c-ff264b484629. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50805637-3e01-4a32-9ef1-fcf27d7ffb04 req-3abbc734-3215-49e5-a18d-d6129c914bdb service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:21 user nova-compute[71285]: INFO nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Booting with volume 88153816-fae2-4266-8f74-c06985cbe41c at /dev/vdc
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7e11d-dcd8-4dbe-af8c-e319f780d5b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f9a20f-4bf3-46a1-96b7-ffa4bd1cc37a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff774a4-f569-4e1a-96a7-011b07f3f0a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab25cbe0-3729-477b-b2c4-9d9648c0b074]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:21 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:20:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e4446-5fc9-493b-9e94-49e379fca2bb]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG os_brick.utils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating existing volume attachment record: 179bd0d9-010e-4c70-b3a3-9cbe98685063 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:20:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:20:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Creating image(s)
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Ensure instance console log exists: /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Start _get_guest_xml network_info=[{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KflzqEtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e', 'attached_at': '', 'detached_at': '', 'volume_id': '09705428-be59-4d47-8c48-3f7a0d94963a', 'serial': '09705428-be59-4d47-8c48-3f7a0d94963a'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'a4ab5580-781f-4df7-b461-24f8a64e5673', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQjCvXBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 'serial': 'f494b4ba-5741-4d3f-8eb1-b5ff89f54337'}, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'attachment_id': '1ea717d4-0f64-43cf-b8ff-b8b6e7a00f85', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPHqTwFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e', 'attached_at': '', 'detached_at': '', 'volume_id': '400b6a69-9110-481d-89de-b9a4dad69bfa', 'serial': '400b6a69-9110-481d-89de-b9a4dad69bfa'}, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'attachment_id': 'b1d159ba-4a4e-4aed-963c-d64e2dae6480', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:20:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connector [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Factory for ISCSI on None {{(pid=71285) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KflzqEtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:23 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23c31b-bd5b-49ac-81c7-16f98d4a6065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b166042-8fd0-4196-9e54-9a1f4dc4656a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a] added
Apr 13 20:20:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7ce36-26f0-4895-a755-5682027374f1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46cb499-ed2a-43c2-b747-ac44a526e880]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KflzqEtI {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KflzqEtI" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b331c8c-1da6-449d-9a18-272f8540faa0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KflzqEtI'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b7b6d-8e31-4e1a-9ef9-513119acfa78]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ae2d1-b946-4fd8-ad6f-5694cf433e2e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:20:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:20:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:20:23 user nova-compute[71285]: 
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d7ec5-3fe0-4bb2-a767-e136d9206e8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260]
Apr 13 20:20:23 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46384c1e-1f80-4ef1-86b5-2f733d6dc188]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[563abda8-f30e-462a-a1ba-2297a4cbc60b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8392ab-db89-4ed5-bec9-65659cceff1b]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KflzqEtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26234653161643965', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234653161643965', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQjCvXBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:25 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5e1e76-d596-46f7-ade8-7f1d21373ae6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:25 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35521f5-8d18-40f6-9d7e-a50d48d8aaa2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337] added
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8c8561-6d07-407a-87db-60552dbbbbd0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40ac021-fdb0-40c0-bfdf-34114fd37cbe]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQjCvXBp {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQjCvXBp" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[857feb1d-7606-45b1-8dc1-f4c1d2e27843]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DQjCvXBp'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ff91ff-a7a6-4c7b-9557-89f154d39f4a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9346559-3285-4c31-96b4-a9dcb95b732a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc445796-8e50-45c8-b019-93f404c2eb81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260]
Apr 13 20:20:25 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[260db7f1-1853-4811-b5d8-ab1c3a8acc57]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f53ad-6f7c-44f3-80c9-f0036f2ddc4a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88ec23-1e20-4006-b1b0-441e47e6290d]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQjCvXBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23163643730386264', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163643730386264', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPHqTwFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:26 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:26 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:26 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e52d9-9a72-4901-8c41-70e7a58982e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:26 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd22eaa9-997f-444e-b6f7-15fc638187eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa] added
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[417822ad-9698-4f2f-bd10-7317abbf932b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df63b430-b42c-4b36-ac29-b6986948395d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPHqTwFI {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPHqTwFI" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[660e0ffe-dc0e-47e7-9b99-5906623515bd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPHqTwFI'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af016c64-0f6e-41b6-ac34-56cda64adc35]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be1c7ae-be44-49ec-9842-db02ddb7a683]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df3b607-8c60-4d11-a0d5-a64520082d20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260]
Apr 13 20:20:26 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48327d69-f3b5-43c7-867a-8e6f12ccf317]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[107d7f50-6c4c-4a4a-80e7-c343bbac5a86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:26 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64d358a-c2c3-4a3f-8f3f-2dc159508765]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPHqTwFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23035333464373137', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035333464373137', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lazy-loading 'pci_devices' on Instance uuid d3a56bab-d00c-4304-8c48-78bd9a9e5d4e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:20:27 user nova-compute[71285]:   <uuid>d3a56bab-d00c-4304-8c48-78bd9a9e5d4e</uuid>
Apr 13 20:20:27 user nova-compute[71285]:   <name>instance-00000009</name>
Apr 13 20:20:27 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:20:27 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:20:27 user nova-compute[71285]:   <metadata>
Apr 13 20:20:27 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:20:27 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:name>tempest-device-tagging-server-194894390</nova:name>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:20:23</nova:creationTime>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:20:27 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:20:27 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:owner>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:user uuid="5a2f99d6d3ee4f1b968dcc6ed6fccb84">tempest-TaggedBootDevicesTest_v242-1937190346-project-member</nova:user>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:project uuid="e01e2122799d4cfe81a642146f5c1421">tempest-TaggedBootDevicesTest_v242-1937190346</nova:project>
Apr 13 20:20:27 user nova-compute[71285]:       </nova:owner>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:20:27 user nova-compute[71285]:       <nova:ports>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="8a43e7e1-8da0-48b7-a18d-8899539118c7">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="cd297158-7c28-4e96-9055-7547d626d066">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.44" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="4e89cf33-c25a-42d7-be8d-bfeeea25e607">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="32e1b953-1235-44ba-918c-ff264b484629">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.208" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="12991ac8-5935-4b35-918a-015677766ea7">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="1af834fc-094c-4fbc-a8fa-abf7d28cec5e">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:         <nova:port uuid="b6c3e557-a7be-4d2a-bd41-1e48291a36cb">
Apr 13 20:20:27 user nova-compute[71285]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 20:20:27 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:27 user nova-compute[71285]:       </nova:ports>
Apr 13 20:20:27 user nova-compute[71285]:     </nova:instance>
Apr 13 20:20:27 user nova-compute[71285]:   </metadata>
Apr 13 20:20:27 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:20:27 user nova-compute[71285]:     <system>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="serial">d3a56bab-d00c-4304-8c48-78bd9a9e5d4e</entry>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="uuid">d3a56bab-d00c-4304-8c48-78bd9a9e5d4e</entry>
Apr 13 20:20:27 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:20:27 user nova-compute[71285]:     </system>
Apr 13 20:20:27 user nova-compute[71285]:   </sysinfo>
Apr 13 20:20:27 user nova-compute[71285]:   <os>
Apr 13 20:20:27 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:20:27 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:20:27 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:20:27 user nova-compute[71285]:   </os>
Apr 13 20:20:27 user nova-compute[71285]:   <features>
Apr 13 20:20:27 user nova-compute[71285]:     <acpi/>
Apr 13 20:20:27 user nova-compute[71285]:     <apic/>
Apr 13 20:20:27 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:20:27 user nova-compute[71285]:   </features>
Apr 13 20:20:27 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:20:27 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:20:27 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:20:27 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:20:27 user nova-compute[71285]:   </clock>
Apr 13 20:20:27 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:20:27 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:20:27 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:20:27 user nova-compute[71285]:   </cpu>
Apr 13 20:20:27 user nova-compute[71285]:   <devices>
Apr 13 20:20:27 user nova-compute[71285]:     <disk type="file" device="cdrom">
Apr 13 20:20:27 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 20:20:27 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/disk.config"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="hda" bus="ide"/>
Apr 13 20:20:27 user nova-compute[71285]:     </disk>
Apr 13 20:20:27 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:27 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:27 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <serial>09705428-be59-4d47-8c48-3f7a0d94963a</serial>
Apr 13 20:20:27 user nova-compute[71285]:     </disk>
Apr 13 20:20:27 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:27 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:27 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <serial>f494b4ba-5741-4d3f-8eb1-b5ff89f54337</serial>
Apr 13 20:20:27 user nova-compute[71285]:     </disk>
Apr 13 20:20:27 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:27 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:27 user nova-compute[71285]:       <source dev="/dev/sdd"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="vdc" bus="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <serial>400b6a69-9110-481d-89de-b9a4dad69bfa</serial>
Apr 13 20:20:27 user nova-compute[71285]:     </disk>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:0f:ba:c6"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tap8a43e7e1-8d"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:aa:0e:b6"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tapcd297158-7c"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:55:0f:f5"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tap4e89cf33-c2"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:91:36:ff"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tap32e1b953-12"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:24:06:cc"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tap12991ac8-59"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:3b:3e:e4"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tap1af834fc-09"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:27 user nova-compute[71285]:       <mac address="fa:16:3e:b0:67:b5"/>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:27 user nova-compute[71285]:       <target dev="tapb6c3e557-a7"/>
Apr 13 20:20:27 user nova-compute[71285]:     </interface>
Apr 13 20:20:27 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:20:27 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/console.log" append="off"/>
Apr 13 20:20:27 user nova-compute[71285]:     </serial>
Apr 13 20:20:27 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:20:27 user nova-compute[71285]:     <video>
Apr 13 20:20:27 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:27 user nova-compute[71285]:     </video>
Apr 13 20:20:27 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:20:27 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:20:27 user nova-compute[71285]:     </rng>
Apr 13 20:20:27 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:20:27 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:20:27 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:20:27 user nova-compute[71285]:     </memballoon>
Apr 13 20:20:27 user nova-compute[71285]:   </devices>
Apr 13 20:20:27 user nova-compute[71285]: </domain>
Apr 13 20:20:27 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a43e7e1-8d, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a43e7e1-8d, col_values=(('external_ids', {'iface-id': '8a43e7e1-8da0-48b7-a18d-8899539118c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:ba:c6', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d')
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd297158-7c, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd297158-7c, col_values=(('external_ids', {'iface-id': 'cd297158-7c28-4e96-9055-7547d626d066', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:0e:b6', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c')
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e89cf33-c2, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e89cf33-c2, col_values=(('external_ids', {'iface-id': '4e89cf33-c25a-42d7-be8d-bfeeea25e607', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:0f:f5', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2')
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32e1b953-12, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32e1b953-12, col_values=(('external_ids', {'iface-id': '32e1b953-1235-44ba-918c-ff264b484629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:36:ff', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12')
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12991ac8-59, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap12991ac8-59, col_values=(('external_ids', {'iface-id': '12991ac8-5935-4b35-918a-015677766ea7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:06:cc', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59')
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1af834fc-09, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1af834fc-09, col_values=(('external_ids', {'iface-id': '1af834fc-094c-4fbc-a8fa-abf7d28cec5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:3e:e4', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09')
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6c3e557-a7, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6c3e557-a7, col_values=(('external_ids', {'iface-id': 'b6c3e557-a7be-4d2a-bd41-1e48291a36cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:67:b5', 'vm-uuid': 'd3a56bab-d00c-4304-8c48-78bd9a9e5d4e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:28 user nova-compute[71285]: INFO os_vif [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7')
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] No BDM found with device name hda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] No VIF found with MAC fa:16:3e:0f:ba:c6, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] No VIF found with MAC fa:16:3e:24:06:cc, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Using config drive
Apr 13 20:20:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Creating config drive at /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/disk.config
Apr 13 20:20:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5v0l89of {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5v0l89of" returned: 0 in 0.054s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:20:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Creating image(s)
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Ensure instance console log exists: /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Start _get_guest_xml network_info=[{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTzHeGiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2979586-cf14-4797-b906-547f3363090c', 'serial': 'b2979586-cf14-4797-b906-547f3363090c'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'bdf3345f-995b-47ce-a605-51d3d7777fa5', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDkvwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 'serial': 'ce955f5a-7ac3-40f7-ac14-f9c88130ab05'}, 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'attachment_id': '12da5a07-10ca-4aaa-9750-353414f98f17', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pvQLZJFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872', 'attached_at': '', 'detached_at': '', 'volume_id': '88153816-fae2-4266-8f74-c06985cbe41c', 'serial': '88153816-fae2-4266-8f74-c06985cbe41c'}, 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'attachment_id': '179bd0d9-010e-4c70-b3a3-9cbe98685063', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTzHeGiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:30 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde8f9d7-6b1e-4222-84c4-f6d42e29b269]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:30 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572c797-27ce-4e1e-8f88-d8eafc3e91e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c] added
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[405fbf0f-14ff-42ea-a963-e776e33e321c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23eabc5-5aaf-432f-bb13-4dd5cc79b45d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTzHeGiP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BTzHeGiP" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[134e469c-f9cd-4b2e-8309-c46324f342af]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BTzHeGiP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae431f4-d9d4-4b4d-acf8-3d2a49b212fd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6209a47b-f962-4540-a4d9-420517e2c9c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1694663f-663d-4e98-8c45-6b744dd69460]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260]
Apr 13 20:20:30 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffec085-9025-46c3-ba94-a61404998549]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:30 user nova-compute[71285]: WARNING nova.compute.manager [req-8bbffa3c-9ccc-4384-858d-0fc99f5c2a34 req-471810ec-0454-4b4f-a3a2-dedb714a7434 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance with vm_state building and task_state spawning.
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbab4f8c-85fc-4106-ae65-d14236c7a6f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:30 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44d36a4-8fdd-431d-976a-4e044abcb98f]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTzHeGiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:30 user nova-compute[71285]: WARNING nova.compute.manager [req-ce69a0cf-57d4-476a-90a3-bf1e6ab6f324 req-7b36bb07-a83b-438f-98e9-d47a8600c7e8 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 for instance with vm_state building and task_state spawning.
Apr 13 20:20:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:31 user nova-compute[71285]: WARNING nova.compute.manager [req-071c74e2-cad0-44ff-b7c0-c59307273f8a req-d05c7662-5231-4822-8344-1398983408aa service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 for instance with vm_state building and task_state spawning.
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26234303066353235', 'path': '/dev/sde'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234303066353235', 'path': '/dev/sde'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDkvwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:31 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:31 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:31 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76c093-a4f9-42b9-8590-e5fa7fc8cec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:31 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.048s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417ab5c-1960-4467-8dde-a5c2204cdee3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05] added
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa613d9e-0703-46f5-921b-0730db01771c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09d512a-9051-48d5-81e2-5ece9b283e47]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmlDkvwX {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TmlDkvwX" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e9e9c-347b-40c2-89b6-77945d30e809]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TmlDkvwX'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6006d-b62a-477a-9aad-a4ea0d0f3f7a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7426447-5496-4868-acfc-3762c83da43e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea0a2b8-8d34-403a-b4cc-8d1a3b4695b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260]
Apr 13 20:20:31 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840cd67-71c3-42a2-8e64-8f6adf88599f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46078683-b2ae-44e1-9886-77788629262c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:31 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.466s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.038s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965b8f4-832b-438a-b227-c39a2ecbd7c9]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDkvwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:32 user nova-compute[71285]: WARNING nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance with vm_state building and task_state spawning.
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:32 user nova-compute[71285]: WARNING nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance with vm_state building and task_state spawning.
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:32 user nova-compute[71285]: WARNING nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance with vm_state building and task_state spawning.
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:32 user nova-compute[71285]: WARNING nova.compute.manager [req-12eae652-27a4-4ba5-9aad-364496c328f9 req-e8ab87e0-a8d4-4079-b3d4-bb192af40371 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance with vm_state building and task_state spawning.
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING nova.compute.manager [req-77abd252-f9e7-4400-b2ab-46c15abe7a6b req-3b1d04d5-9812-4312-ab1f-44e7ea42cc28 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 for instance with vm_state building and task_state spawning.
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.535s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== connect_volume: return (1536ms) {'type': 'block', 'scsi_wwn': '23739316164383236', 'path': '/dev/sdf'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739316164383236', 'path': '/dev/sdf'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pvQLZJFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:33 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6150de-2860-4d9a-9615-7a773730a913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:33 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6c95ed-d43b-4ad3-a5e3-77102557438e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c] added
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[522e9ab9-00d5-4ae4-b0dd-11fcb4863b89]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a182772f-3120-48c5-b294-89f6ef4ce9ad]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pvQLZJFT {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pvQLZJFT" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c70e9e-d17a-46d1-9b35-a0ccb5a4efe4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pvQLZJFT'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11868dd4-f481-43cc-9bd6-242d45325ddc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 for instance with vm_state building and task_state spawning.
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 for instance with vm_state building and task_state spawning.
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:33 user nova-compute[71285]: WARNING nova.compute.manager [req-eb2b6879-ec68-4314-b064-791cec2fcc12 req-0c8c8687-47bf-47fd-be25-81c214a91c51 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 for instance with vm_state building and task_state spawning.
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43517f-be87-4d47-b1af-76808f574ff3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4a4432-f795-430f-b34e-c6a9b5af2f3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260]
Apr 13 20:20:33 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9edfbb-a00d-4b7c-99ff-ef210b6324fe]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f646e-b7f9-40f1-ba90-a7ded41e90c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:33 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.466s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255d851-3ef1-45fc-84c3-fe7d1c436df5]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pvQLZJFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:34 user nova-compute[71285]: WARNING nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance with vm_state building and task_state spawning.
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:34 user nova-compute[71285]: WARNING nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance with vm_state building and task_state spawning.
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:34 user nova-compute[71285]: WARNING nova.compute.manager [req-6e4ad3c8-e79a-4c68-861d-a6183075b09f req-eb5b92e6-6d52-4d8c-a6c5-f35338832d06 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance with vm_state building and task_state spawning.
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '26466383132653031', 'path': '/dev/sdg'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466383132653031', 'path': '/dev/sdg'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lazy-loading 'pci_devices' on Instance uuid 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:20:34 user nova-compute[71285]:   <uuid>8587fcac-cc5b-4fe7-92f9-8bf675a9a872</uuid>
Apr 13 20:20:34 user nova-compute[71285]:   <name>instance-00000008</name>
Apr 13 20:20:34 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:20:34 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:20:34 user nova-compute[71285]:   <metadata>
Apr 13 20:20:34 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:20:34 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:name>tempest-device-tagging-server-1152408138</nova:name>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:20:30</nova:creationTime>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:20:34 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:20:34 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:owner>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:user uuid="1dc7db2b4cb64d2e9ad08692b248bb18">tempest-TaggedBootDevicesTest-619300676-project-member</nova:user>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:project uuid="9ced32cd96594324b6b8792ef56e28c5">tempest-TaggedBootDevicesTest-619300676</nova:project>
Apr 13 20:20:34 user nova-compute[71285]:       </nova:owner>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:20:34 user nova-compute[71285]:       <nova:ports>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="b2c1c646-b65c-4543-bf25-b89ff954fdd1">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="58a1b4af-7470-4cef-8c7a-7e611f8942fb">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="51a691d6-af80-4126-9fa3-99fd3ee39a9d">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="0fc22c68-14c3-4803-952d-32dac032db89">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="ee2ced5f-3757-4527-a93f-72d920a58291">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.1.1.123" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="b3deaefd-62cd-4147-b744-783c9f5ff678">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:         <nova:port uuid="68c624f1-a380-4397-b311-6104fad344a8">
Apr 13 20:20:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 13 20:20:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:34 user nova-compute[71285]:       </nova:ports>
Apr 13 20:20:34 user nova-compute[71285]:     </nova:instance>
Apr 13 20:20:34 user nova-compute[71285]:   </metadata>
Apr 13 20:20:34 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:20:34 user nova-compute[71285]:     <system>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="serial">8587fcac-cc5b-4fe7-92f9-8bf675a9a872</entry>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="uuid">8587fcac-cc5b-4fe7-92f9-8bf675a9a872</entry>
Apr 13 20:20:34 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:20:34 user nova-compute[71285]:     </system>
Apr 13 20:20:34 user nova-compute[71285]:   </sysinfo>
Apr 13 20:20:34 user nova-compute[71285]:   <os>
Apr 13 20:20:34 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:20:34 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:20:34 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:20:34 user nova-compute[71285]:   </os>
Apr 13 20:20:34 user nova-compute[71285]:   <features>
Apr 13 20:20:34 user nova-compute[71285]:     <acpi/>
Apr 13 20:20:34 user nova-compute[71285]:     <apic/>
Apr 13 20:20:34 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:20:34 user nova-compute[71285]:   </features>
Apr 13 20:20:34 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:20:34 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:20:34 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:20:34 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:20:34 user nova-compute[71285]:   </clock>
Apr 13 20:20:34 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:20:34 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:20:34 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:20:34 user nova-compute[71285]:   </cpu>
Apr 13 20:20:34 user nova-compute[71285]:   <devices>
Apr 13 20:20:34 user nova-compute[71285]:     <disk type="file" device="cdrom">
Apr 13 20:20:34 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none"/>
Apr 13 20:20:34 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/disk.config"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="hda" bus="ide"/>
Apr 13 20:20:34 user nova-compute[71285]:     </disk>
Apr 13 20:20:34 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:34 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:34 user nova-compute[71285]:       <source dev="/dev/sde"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <serial>b2979586-cf14-4797-b906-547f3363090c</serial>
Apr 13 20:20:34 user nova-compute[71285]:     </disk>
Apr 13 20:20:34 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:34 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:34 user nova-compute[71285]:       <source dev="/dev/sdf"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <serial>ce955f5a-7ac3-40f7-ac14-f9c88130ab05</serial>
Apr 13 20:20:34 user nova-compute[71285]:     </disk>
Apr 13 20:20:34 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:20:34 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:34 user nova-compute[71285]:       <source dev="/dev/sdg"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="vdc" bus="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <serial>88153816-fae2-4266-8f74-c06985cbe41c</serial>
Apr 13 20:20:34 user nova-compute[71285]:     </disk>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:83:28:28"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tapb2c1c646-b6"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:eb:78:b7"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tap58a1b4af-74"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:7d:86:66"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tap51a691d6-af"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:3a:1e:06"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tap0fc22c68-14"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:98:0c:0e"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tapee2ced5f-37"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:55:e0:68"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tapb3deaefd-62"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:34 user nova-compute[71285]:       <mac address="fa:16:3e:b4:53:2b"/>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:34 user nova-compute[71285]:       <target dev="tap68c624f1-a3"/>
Apr 13 20:20:34 user nova-compute[71285]:     </interface>
Apr 13 20:20:34 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:20:34 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/console.log" append="off"/>
Apr 13 20:20:34 user nova-compute[71285]:     </serial>
Apr 13 20:20:34 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:20:34 user nova-compute[71285]:     <video>
Apr 13 20:20:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:34 user nova-compute[71285]:     </video>
Apr 13 20:20:34 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:20:34 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:20:34 user nova-compute[71285]:     </rng>
Apr 13 20:20:34 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:20:34 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:20:34 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:20:34 user nova-compute[71285]:     </memballoon>
Apr 13 20:20:34 user nova-compute[71285]:   </devices>
Apr 13 20:20:34 user nova-compute[71285]: </domain>
Apr 13 20:20:34 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2c1c646-b6, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2c1c646-b6, col_values=(('external_ids', {'iface-id': 'b2c1c646-b65c-4543-bf25-b89ff954fdd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:28:28', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6')
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58a1b4af-74, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58a1b4af-74, col_values=(('external_ids', {'iface-id': '58a1b4af-7470-4cef-8c7a-7e611f8942fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:78:b7', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74')
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51a691d6-af, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51a691d6-af, col_values=(('external_ids', {'iface-id': '51a691d6-af80-4126-9fa3-99fd3ee39a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:86:66', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af')
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fc22c68-14, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fc22c68-14, col_values=(('external_ids', {'iface-id': '0fc22c68-14c3-4803-952d-32dac032db89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:1e:06', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14')
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee2ced5f-37, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee2ced5f-37, col_values=(('external_ids', {'iface-id': 'ee2ced5f-3757-4527-a93f-72d920a58291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:0c:0e', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37')
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3deaefd-62, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3deaefd-62, col_values=(('external_ids', {'iface-id': 'b3deaefd-62cd-4147-b744-783c9f5ff678', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:e0:68', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417234.9711545, d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] VM Resumed (Lifecycle Event)
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:20:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance spawned successfully.
Apr 13 20:20:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:35 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62')
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417234.979544, d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] VM Started (Lifecycle Event)
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68c624f1-a3, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68c624f1-a3, col_values=(('external_ids', {'iface-id': '68c624f1-a380-4397-b311-6104fad344a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:53:2b', 'vm-uuid': '8587fcac-cc5b-4fe7-92f9-8bf675a9a872'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Took 11.46 seconds to spawn the instance on the hypervisor.
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:35 user nova-compute[71285]: INFO os_vif [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3')
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] No BDM found with device name hda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] No VIF found with MAC fa:16:3e:83:28:28, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] No VIF found with MAC fa:16:3e:98:0c:0e, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Using config drive
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.compute.manager [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Took 40.91 seconds to build instance.
Apr 13 20:20:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4534c6c9-2bf4-4502-998a-e1edbce76160 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.034s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Creating config drive at /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/disk.config
Apr 13 20:20:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5j7c20gz {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5j7c20gz" returned: 0 in 0.064s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:37 user nova-compute[71285]: WARNING nova.compute.manager [req-acbf7341-320c-4810-9693-39ce3e095206 req-e025b146-0082-4365-bb50-770802107b36 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance with vm_state building and task_state spawning.
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:20:37 user nova-compute[71285]: INFO nova.compute.claims [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Claim successful on node user
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:37 user nova-compute[71285]: WARNING nova.compute.manager [req-55b0f12d-a53b-4666-87d9-e13e7e05b703 req-4fd82494-e74b-42c9-ae18-708987e51247 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance with vm_state building and task_state spawning.
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:20:37 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.669s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:38 user nova-compute[71285]: WARNING nova.compute.manager [req-920a5033-7581-42b5-ba9d-df817fcab0d8 req-c126755e-7d1b-4c34-a61b-a6ea24cb24c9 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 for instance with vm_state building and task_state spawning.
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:20:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:20:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Creating image(s)
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "/opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "/opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "/opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG nova.policy [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be2777ed1017497ba7d96ca9d28e4d0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b0fe0b98cb1466db76778e75e76bbc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.226s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.186s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk 1073741824" returned: 0 in 0.076s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-6af1126c-5b6c-4142-a46e-42a0e45fd803 req-0e876308-d3c9-4538-bc23-cec4924b3503 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Cannot resize image /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lazy-loading 'migration_context' on Instance uuid 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Ensure instance console log exists: /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Successfully created port: afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 for instance with vm_state building and task_state spawning.
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:39 user nova-compute[71285]: WARNING nova.compute.manager [req-c2c52448-20f7-48be-818d-0aa1642254d7 req-10450c77-b269-4840-8c92-371e8c681dd2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 for instance with vm_state building and task_state spawning.
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:40 user nova-compute[71285]: WARNING nova.compute.manager [req-9423cc93-8141-4ad8-aefd-5f92fa767cc0 req-9959475e-930d-4f62-8cc9-e76149d5b3fb service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 for instance with vm_state building and task_state spawning.
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Successfully updated port: afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquired lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Updating instance_info_cache with network_info: [{"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Releasing lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Instance network_info: |[{"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Start _get_guest_xml network_info=[{"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:20:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-757898920',display_name='tempest-VolumesNegativeTest-instance-757898920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-757898920',id=10,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0fe0b98cb1466db76778e75e76bbc8',ramdisk_id='',reservation_id='r-zppqrutu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1033466652',owner_user_name='tempest-VolumesNegativeTest-1033466652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:20:38Z,user_data=None,user_id='be2777ed1017497ba7d96ca9d28e4d0c',uuid=4586f280-bf80-4ec1-b5bd-b51c11dc4d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converting VIF {"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lazy-loading 'pci_devices' on Instance uuid 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:20:40 user nova-compute[71285]:   <uuid>4586f280-bf80-4ec1-b5bd-b51c11dc4d38</uuid>
Apr 13 20:20:40 user nova-compute[71285]:   <name>instance-0000000a</name>
Apr 13 20:20:40 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:20:40 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:20:40 user nova-compute[71285]:   <metadata>
Apr 13 20:20:40 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:20:40 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:name>tempest-VolumesNegativeTest-instance-757898920</nova:name>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:20:40</nova:creationTime>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:20:40 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:20:40 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:owner>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:user uuid="be2777ed1017497ba7d96ca9d28e4d0c">tempest-VolumesNegativeTest-1033466652-project-member</nova:user>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:project uuid="7b0fe0b98cb1466db76778e75e76bbc8">tempest-VolumesNegativeTest-1033466652</nova:project>
Apr 13 20:20:40 user nova-compute[71285]:       </nova:owner>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:20:40 user nova-compute[71285]:       <nova:ports>
Apr 13 20:20:40 user nova-compute[71285]:         <nova:port uuid="afb15346-ee62-4c52-9603-035c27a22167">
Apr 13 20:20:40 user nova-compute[71285]:           <nova:ip type="fixed" address="192.168.233.130" ipVersion="4"/>
Apr 13 20:20:40 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:40 user nova-compute[71285]:       </nova:ports>
Apr 13 20:20:40 user nova-compute[71285]:     </nova:instance>
Apr 13 20:20:40 user nova-compute[71285]:   </metadata>
Apr 13 20:20:40 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:20:40 user nova-compute[71285]:     <system>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="serial">4586f280-bf80-4ec1-b5bd-b51c11dc4d38</entry>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="uuid">4586f280-bf80-4ec1-b5bd-b51c11dc4d38</entry>
Apr 13 20:20:40 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:20:40 user nova-compute[71285]:     </system>
Apr 13 20:20:40 user nova-compute[71285]:   </sysinfo>
Apr 13 20:20:40 user nova-compute[71285]:   <os>
Apr 13 20:20:40 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:20:40 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:20:40 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:20:40 user nova-compute[71285]:   </os>
Apr 13 20:20:40 user nova-compute[71285]:   <features>
Apr 13 20:20:40 user nova-compute[71285]:     <acpi/>
Apr 13 20:20:40 user nova-compute[71285]:     <apic/>
Apr 13 20:20:40 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:20:40 user nova-compute[71285]:   </features>
Apr 13 20:20:40 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:20:40 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:20:40 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:20:40 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:20:40 user nova-compute[71285]:   </clock>
Apr 13 20:20:40 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:20:40 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:20:40 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:20:40 user nova-compute[71285]:   </cpu>
Apr 13 20:20:40 user nova-compute[71285]:   <devices>
Apr 13 20:20:40 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:20:40 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:20:40 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk"/>
Apr 13 20:20:40 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:20:40 user nova-compute[71285]:     </disk>
Apr 13 20:20:40 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:40 user nova-compute[71285]:       <mac address="fa:16:3e:3f:4f:29"/>
Apr 13 20:20:40 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:40 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:40 user nova-compute[71285]:       <target dev="tapafb15346-ee"/>
Apr 13 20:20:40 user nova-compute[71285]:     </interface>
Apr 13 20:20:40 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:20:40 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/console.log" append="off"/>
Apr 13 20:20:40 user nova-compute[71285]:     </serial>
Apr 13 20:20:40 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:20:40 user nova-compute[71285]:     <video>
Apr 13 20:20:40 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:40 user nova-compute[71285]:     </video>
Apr 13 20:20:40 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:20:40 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:20:40 user nova-compute[71285]:     </rng>
Apr 13 20:20:40 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:20:40 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:20:40 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:20:40 user nova-compute[71285]:     </memballoon>
Apr 13 20:20:40 user nova-compute[71285]:   </devices>
Apr 13 20:20:40 user nova-compute[71285]: </domain>
Apr 13 20:20:40 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-757898920',display_name='tempest-VolumesNegativeTest-instance-757898920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-757898920',id=10,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b0fe0b98cb1466db76778e75e76bbc8',ramdisk_id='',reservation_id='r-zppqrutu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1033466652',owner_user_name='tempest-VolumesNegativeTest-1033466652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:20:38Z,user_data=None,user_id='be2777ed1017497ba7d96ca9d28e4d0c',uuid=4586f280-bf80-4ec1-b5bd-b51c11dc4d38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converting VIF {"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG os_vif [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafb15346-ee, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapafb15346-ee, col_values=(('external_ids', {'iface-id': 'afb15346-ee62-4c52-9603-035c27a22167', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:4f:29', 'vm-uuid': '4586f280-bf80-4ec1-b5bd-b51c11dc4d38'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:40 user nova-compute[71285]: INFO os_vif [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee')
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] No VIF found with MAC fa:16:3e:3f:4f:29, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:41 user nova-compute[71285]: WARNING nova.compute.manager [req-b728acac-3fb7-481f-bd78-63e97aceefae req-2e108896-87e2-4eef-98d2-2ab6e08706d5 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 for instance with vm_state building and task_state spawning.
Apr 13 20:20:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417241.5314026, 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] VM Resumed (Lifecycle Event)
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance spawned successfully.
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417241.5333726, 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] VM Started (Lifecycle Event)
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Took 11.65 seconds to spawn the instance on the hypervisor.
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.manager [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Took 49.79 seconds to build instance.
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d24cad21-87f9-410a-ae38-fb1527eca838 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.897s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:20:41 user nova-compute[71285]: INFO nova.compute.claims [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Claim successful on node user
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-changed-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Refreshing instance network info cache due to event network-changed-afb15346-ee62-4c52-9603-035c27a22167. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Acquiring lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Acquired lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Refreshing network info cache for port afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:20:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.policy [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:20:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Creating image(s)
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "/opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "/opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Updated VIF entry in instance network info cache for port afb15346-ee62-4c52-9603-035c27a22167. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Updating instance_info_cache with network_info: [{"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-adf13104-0d15-4593-8d35-5b4dd052f188 req-5770fc85-d57d-413d-baf2-ebbc2ad0f73c service nova] Releasing lock "refresh_cache-4586f280-bf80-4ec1-b5bd-b51c11dc4d38" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk 1073741824" returned: 0 in 0.060s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] No waiting events found dispatching network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:43 user nova-compute[71285]: WARNING nova.compute.manager [req-6ff9b86e-0e29-4992-816c-9162363f2c61 req-fee16811-0789-4c1e-b145-dee87f9dd79b service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received unexpected event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 for instance with vm_state building and task_state spawning.
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Cannot resize image /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'migration_context' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Ensure instance console log exists: /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:43 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updating instance_info_cache with network_info: [{"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-b6fde0f5-70fc-49a5-96f9-b67ed1662a10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Successfully created port: a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417244.6769145, 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] VM Resumed (Lifecycle Event)
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Instance spawned successfully.
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417244.6781173, 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] VM Started (Lifecycle Event)
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Took 6.48 seconds to spawn the instance on the hypervisor.
Apr 13 20:20:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:44 user nova-compute[71285]: INFO nova.compute.manager [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Took 7.62 seconds to build instance.
Apr 13 20:20:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d309a2a3-799b-4c68-afc4-4c7688368986 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.755s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] No waiting events found dispatching network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:45 user nova-compute[71285]: WARNING nova.compute.manager [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received unexpected event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 for instance with vm_state active and task_state None.
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing instance network info cache due to event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.network.neutron [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lazy-loading 'flavor' on Instance uuid b6fde0f5-70fc-49a5-96f9-b67ed1662a10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Successfully updated port: a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquired lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:45 user nova-compute[71285]: INFO nova.compute.manager [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Attaching volume 132f09e1-e79c-4e4b-a11e-6548ba02aee6 to /dev/vdb
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG os_brick.utils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a592134-1ea7-4a5f-8cf8-2c29e53b2131]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[254c8b6a-4d67-4bd9-a32c-f6662b51f298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3988d-baca-4c76-8c12-805a9a99acac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[66aa96bb-0387-4a2a-9f4f-ceaf7bb7dc58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Releasing lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:45 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Instance network_info: |[{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.neutron [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated VIF entry in instance network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.neutron [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:20:46 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3324f86c-91ce-427c-935f-c589ad38dc56]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Start _get_guest_xml network_info=[{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG os_brick.utils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updating existing volume attachment record: 454a3a4b-11ad-4358-ac63-912496b1c4dc {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1df85dbb-5a3e-417f-b5cc-91b7d451c7ed req-f5e097df-f07d-4b2f-8a08-07d3cc472c5e service nova] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:46 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:46 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1172702095',display_name='tempest-TestStampPattern-server-1172702095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1172702095',id=11,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-8fuqihak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:20:43Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=b9e0bb04-2572-4973-af9c-a607ca0b170b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'pci_devices' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.444s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:20:46 user nova-compute[71285]:   <uuid>b9e0bb04-2572-4973-af9c-a607ca0b170b</uuid>
Apr 13 20:20:46 user nova-compute[71285]:   <name>instance-0000000b</name>
Apr 13 20:20:46 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:20:46 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:20:46 user nova-compute[71285]:   <metadata>
Apr 13 20:20:46 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:20:46 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:name>tempest-TestStampPattern-server-1172702095</nova:name>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:20:46</nova:creationTime>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:20:46 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:20:46 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:owner>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:user uuid="29ed39378db34acd835d13c0cacad399">tempest-TestStampPattern-1872935518-project-member</nova:user>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:project uuid="d32350a5bf9a4d8b80c6bc1708387d1f">tempest-TestStampPattern-1872935518</nova:project>
Apr 13 20:20:46 user nova-compute[71285]:       </nova:owner>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:20:46 user nova-compute[71285]:       <nova:ports>
Apr 13 20:20:46 user nova-compute[71285]:         <nova:port uuid="a174e8a4-6618-4819-92fe-4e08da521d07">
Apr 13 20:20:46 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:20:46 user nova-compute[71285]:         </nova:port>
Apr 13 20:20:46 user nova-compute[71285]:       </nova:ports>
Apr 13 20:20:46 user nova-compute[71285]:     </nova:instance>
Apr 13 20:20:46 user nova-compute[71285]:   </metadata>
Apr 13 20:20:46 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:20:46 user nova-compute[71285]:     <system>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="serial">b9e0bb04-2572-4973-af9c-a607ca0b170b</entry>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="uuid">b9e0bb04-2572-4973-af9c-a607ca0b170b</entry>
Apr 13 20:20:46 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:20:46 user nova-compute[71285]:     </system>
Apr 13 20:20:46 user nova-compute[71285]:   </sysinfo>
Apr 13 20:20:46 user nova-compute[71285]:   <os>
Apr 13 20:20:46 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:20:46 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:20:46 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:20:46 user nova-compute[71285]:   </os>
Apr 13 20:20:46 user nova-compute[71285]:   <features>
Apr 13 20:20:46 user nova-compute[71285]:     <acpi/>
Apr 13 20:20:46 user nova-compute[71285]:     <apic/>
Apr 13 20:20:46 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:20:46 user nova-compute[71285]:   </features>
Apr 13 20:20:46 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:20:46 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:20:46 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:20:46 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:20:46 user nova-compute[71285]:   </clock>
Apr 13 20:20:46 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:20:46 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:20:46 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:20:46 user nova-compute[71285]:   </cpu>
Apr 13 20:20:46 user nova-compute[71285]:   <devices>
Apr 13 20:20:46 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:20:46 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:20:46 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk"/>
Apr 13 20:20:46 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:20:46 user nova-compute[71285]:     </disk>
Apr 13 20:20:46 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:20:46 user nova-compute[71285]:       <mac address="fa:16:3e:58:bb:03"/>
Apr 13 20:20:46 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:46 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:20:46 user nova-compute[71285]:       <target dev="tapa174e8a4-66"/>
Apr 13 20:20:46 user nova-compute[71285]:     </interface>
Apr 13 20:20:46 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:20:46 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/console.log" append="off"/>
Apr 13 20:20:46 user nova-compute[71285]:     </serial>
Apr 13 20:20:46 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:20:46 user nova-compute[71285]:     <video>
Apr 13 20:20:46 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:20:46 user nova-compute[71285]:     </video>
Apr 13 20:20:46 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:20:46 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:20:46 user nova-compute[71285]:     </rng>
Apr 13 20:20:46 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:20:46 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:20:46 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:20:46 user nova-compute[71285]:     </memballoon>
Apr 13 20:20:46 user nova-compute[71285]:   </devices>
Apr 13 20:20:46 user nova-compute[71285]: </domain>
Apr 13 20:20:46 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1172702095',display_name='tempest-TestStampPattern-server-1172702095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1172702095',id=11,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-8fuqihak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:20:43Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=b9e0bb04-2572-4973-af9c-a607ca0b170b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG os_vif [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa174e8a4-66, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa174e8a4-66, col_values=(('external_ids', {'iface-id': 'a174e8a4-6618-4819-92fe-4e08da521d07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:bb:03', 'vm-uuid': 'b9e0bb04-2572-4973-af9c-a607ca0b170b'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:46 user nova-compute[71285]: INFO os_vif [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66')
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No VIF found with MAC fa:16:3e:58:bb:03, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:46 user nova-compute[71285]: INFO nova.compute.manager [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] instance snapshotting
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Beginning live snapshot process
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing instance network info cache due to event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Acquiring lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Acquired lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG nova.network.neutron [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.191s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789.delta 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789.delta 1073741824" returned: 0 in 0.066s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 20:20:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71285) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 13 20:20:47 user nova-compute[71285]: INFO nova.virt.libvirt.host [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] UEFI support detected
Apr 13 20:20:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updated VIF entry in instance network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-77aa151e-13bd-4495-89a8-ec1cf24fc653 req-729a0e10-5591-42c2-8533-078aa1904968 service nova] Releasing lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing instance network info cache due to event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.network.neutron [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:20:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=26.67314910888672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789.delta /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance da17669c-1ea2-450a-8183-40b47c4f41fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a78111f4-fcd5-4efc-977e-d8d32225c83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:20:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789.delta /opt/stack/data/nova/instances/snapshots/tmpk07memh_/8c80889107804f398b81b02e275e6789" returned: 0 in 0.391s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:50 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Snapshot extracted, beginning image upload
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.network.neutron [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updated VIF entry in instance network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.network.neutron [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] No waiting events found dispatching network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:50 user nova-compute[71285]: WARNING nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received unexpected event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 for instance with vm_state building and task_state spawning.
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] No waiting events found dispatching network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:50 user nova-compute[71285]: WARNING nova.compute.manager [req-1b875104-cf96-46d4-8eee-ec2feafe8e9d req-363863ef-4bbe-44db-87e0-e7365ef528ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received unexpected event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 for instance with vm_state building and task_state spawning.
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:20:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.796s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417251.5647137, b9e0bb04-2572-4973-af9c-a607ca0b170b => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] VM Resumed (Lifecycle Event)
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Instance spawned successfully.
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417251.5651438, b9e0bb04-2572-4973-af9c-a607ca0b170b => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] VM Started (Lifecycle Event)
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQDPmNGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:51 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:51 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:51 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77f6d4-88b6-47fd-ab84-92f675f637b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:20:51 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Took 8.90 seconds to spawn the instance on the hypervisor.
Apr 13 20:20:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1b8862-16b8-455b-9ab8-d34ef3d671f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6] added
Apr 13 20:20:51 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a712a40c-a3c7-4872-816b-36cb30085de6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6cb5dc-2169-4c3b-8648-db69e9d1bf0b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQDPmNGO {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: INFO nova.compute.manager [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Took 9.88 seconds to build instance.
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQDPmNGO" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6202900c-e10e-4a51-bb4e-d5158d04efc9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQDPmNGO'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a7acdb63-fb08-4cd5-9b8e-bf03aa98fd15 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.005s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4cf8a-dee8-475c-89b5-267818a793a3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed0c34c-d67b-4935-92b2-37b53a6b94da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:51 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:51 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:51 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6f420-cb89-4746-9608-2dd29238e144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260]
Apr 13 20:20:52 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b0814-3aa8-4713-8faa-233b7f5f6cbb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb3f0a-0d2b-45fa-824a-ff531392d9e1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:52 user nova-compute[71285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)
Apr 13 20:20:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[201f445a-32ca-47e2-83f2-db87d1cfe430]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQDPmNGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:52 user nova-compute[71285]: INFO nova.compute.manager [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Shelving
Apr 13 20:20:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:52 user nova-compute[71285]: WARNING nova.compute.manager [req-9c4f5ab6-18e1-4354-9d72-6dbfdf56f8d9 req-b9d2b665-761f-46aa-87ad-90adcdff69a7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state active and task_state shelving.
Apr 13 20:20:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23566376434666563', 'path': '/dev/sdh'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566376434666563', 'path': '/dev/sdh'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lazy-loading 'flavor' on Instance uuid b6fde0f5-70fc-49a5-96f9-b67ed1662a10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:20:53 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:20:53 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:20:53 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:20:53 user nova-compute[71285]:   <serial>132f09e1-e79c-4e4b-a11e-6548ba02aee6</serial>
Apr 13 20:20:53 user nova-compute[71285]: </disk>
Apr 13 20:20:53 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Snapshot image upload complete
Apr 13 20:20:53 user nova-compute[71285]: INFO nova.compute.manager [None req-51b7cc7f-b22e-46ee-8470-34457520a734 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Took 6.64 seconds to snapshot the instance on the hypervisor.
Apr 13 20:20:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance destroyed successfully.
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] No VIF found with MAC fa:16:3e:41:fe:20, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:20:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Beginning cold snapshot process
Apr 13 20:20:53 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk /opt/stack/data/nova/instances/snapshots/tmpk8tln91r/c5e6eff59a0644dbbed94e77a6a198d6 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4c6d0e4e-735f-4b27-86f2-fb22a1cf9bfc tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.163s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk /opt/stack/data/nova/instances/snapshots/tmpk8tln91r/c5e6eff59a0644dbbed94e77a6a198d6" returned: 0 in 0.401s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Snapshot extracted, beginning image upload
Apr 13 20:20:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:54 user nova-compute[71285]: WARNING nova.compute.manager [req-81a1a777-9f69-46a9-a95e-7e635553f97f req-2eb7ffff-dc16-4aac-9659-1f4d91e1c71c service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:54 user nova-compute[71285]: INFO nova.compute.manager [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Terminating instance
Apr 13 20:20:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-unplugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] No waiting events found dispatching network-vif-unplugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-01f56461-016f-4cc7-8225-2b37fc562450 req-53f3bf82-ab73-4315-b58a-653c9a649f6e service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-unplugged-647040e8-c10a-43ef-ae04-6be7319fae12 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:20:55 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Instance destroyed successfully.
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lazy-loading 'resources' on Instance uuid b6fde0f5-70fc-49a5-96f9-b67ed1662a10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-763294771',display_name='tempest-DeleteServersTestJSON-server-763294771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-763294771',id=2,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da6301bd811748429fd4bc6b1205e07d',ramdisk_id='',reservation_id='r-bipmtg2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-537831244',owner_user_name='tempest-DeleteServersTestJSON-537831244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:07Z,user_data=None,user_id='b50309fc4b92451f8cc40e92b10861ba',uuid=b6fde0f5-70fc-49a5-96f9-b67ed1662a10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converting VIF {"id": "647040e8-c10a-43ef-ae04-6be7319fae12", "address": "fa:16:3e:41:fe:20", "network": {"id": "398c479c-fb42-41ad-8dbc-ee2b84e9fa05", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1974944571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da6301bd811748429fd4bc6b1205e07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap647040e8-c1", "ovs_interfaceid": "647040e8-c10a-43ef-ae04-6be7319fae12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_vif [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap647040e8-c1, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:55 user nova-compute[71285]: INFO os_vif [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:fe:20,bridge_name='br-int',has_traffic_filtering=True,id=647040e8-c10a-43ef-ae04-6be7319fae12,network=Network(398c479c-fb42-41ad-8dbc-ee2b84e9fa05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap647040e8-c1')
Apr 13 20:20:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQDPmNGO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:20:55 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcddfa32-f43f-42bb-9807-af6ac922ed39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:20:55 user nova-compute[71285]: No targets found.
Apr 13 20:20:55 user nova-compute[71285]: iSNS:
Apr 13 20:20:55 user nova-compute[71285]: No targets found.
Apr 13 20:20:55 user nova-compute[71285]: STATIC:
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:20:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:20:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:20:55 user nova-compute[71285]: FIRMWARE:
Apr 13 20:20:55 user nova-compute[71285]: No targets found.
Apr 13 20:20:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:20:55 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:20:55 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[187ce37f-18f5-4a57-9a65-2f22bdaf702c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6495c99e-b958-4faf-99fd-e64ff4e5db68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:20:55 user nova-compute[71285]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 (non-flash)
Apr 13 20:20:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645843a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6'): ({'sdh'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Removing single pathed devices sdh {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c5fc05-edbb-41fe-b648-4f3bc0b81f2a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b942c018-24eb-4aae-bdfc-15ed9535186b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Flushing IO for device /dev/sdh {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:20:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c182dd-553d-4fbe-8cd9-ebece4786756]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c81030f-9204-4e5e-a434-6ae3e898b74d]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef5252-c519-4240-ba20-5ef39f7c8786]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[636d832d-f5aa-4d5a-83da-5debbd401b65]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260]
Apr 13 20:20:56 user nova-compute[71285]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6, portal: 172.16.0.220,3260] successful.
Apr 13 20:20:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:132f09e1-e79c-4e4b-a11e-6548ba02aee6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.060s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d22a803-6b1e-4245-a7be-ba06d3c54a4f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] <== disconnect_volume: return (376ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:20:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Deleting instance files /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10_del
Apr 13 20:20:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Deletion of /opt/stack/data/nova/instances/b6fde0f5-70fc-49a5-96f9-b67ed1662a10_del complete
Apr 13 20:20:56 user nova-compute[71285]: INFO nova.compute.manager [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Took 1.34 seconds to destroy the instance on the hypervisor.
Apr 13 20:20:56 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Snapshot image upload complete
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:56 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Took 0.65 seconds to deallocate network for instance.
Apr 13 20:20:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-45d9759e-ad55-44de-8b8a-0faa229a4f46 req-58af1d40-8450-46d9-9cc8-618cafe8ec6f service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-deleted-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:57 user nova-compute[71285]: INFO nova.compute.manager [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Shelve offloading
Apr 13 20:20:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance destroyed successfully.
Apr 13 20:20:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Acquiring lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] No waiting events found dispatching network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:20:57 user nova-compute[71285]: WARNING nova.compute.manager [req-654e4d61-78f1-41cf-a5a1-c588816c656e req-eca10483-31d6-4056-b62c-f8e109d81905 service nova] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Received unexpected event network-vif-plugged-647040e8-c10a-43ef-ae04-6be7319fae12 for instance with vm_state active and task_state deleting.
Apr 13 20:20:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:20:57 user nova-compute[71285]: INFO nova.compute.manager [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Took 0.89 seconds to detach 1 volumes for instance.
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.772s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:58 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Deleted allocations for instance b6fde0f5-70fc-49a5-96f9-b67ed1662a10
Apr 13 20:20:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0bb40998-42b9-4f43-8310-e0ef60f2772b tempest-DeleteServersTestJSON-537831244 tempest-DeleteServersTestJSON-537831244-project-member] Lock "b6fde0f5-70fc-49a5-96f9-b67ed1662a10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.886s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance destroyed successfully.
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'resources' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQLEfnUAdwXiipQWQC6KVFeB1qTwUX2x1/w1l3Smwk+oocpgJJtYwCafCK7wWtX/jdQXFNg9495lZCIwIq0anujj/KJcgFvWh54vZk//EcBX7yDONmBSz2eGEsOBPB1w==',key_name='tempest-keypair-1146136459',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:20:56.949999',shelved_host='user',shelved_image_id='a76a99e5-65d1-4a80-a052-6ac65e85aeb3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG os_vif [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf3a82f9-8c, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:20:58 user nova-compute[71285]: INFO os_vif [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c')
Apr 13 20:20:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Deleting instance files /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9_del
Apr 13 20:20:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Deletion of /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9_del complete
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing instance network info cache due to event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:20:59 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Deleted allocations for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ecc826b9-82ba-44c6-9793-84a12ed119a9 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.110s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updated VIF entry in instance network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:20:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14f6de40-0b28-41eb-b09f-d768d77b0211 req-bd144fdb-1b53-4522-9023-aaf9150ef8f9 service nova] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-changed-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Refreshing instance network info cache due to event network-changed-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Acquiring lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Acquired lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Refreshing network info cache for port 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updated VIF entry in instance network info cache for port 11b35baa-5ecc-4d79-ba64-fd5ab401d2b1. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating instance_info_cache with network_info: [{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82050446-5d56-4df0-b4f0-9dc0a538ffb8 req-3512756d-37ac-4c4d-a1d4-5c00bf9721f8 service nova] Releasing lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'flavor' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:03 user nova-compute[71285]: INFO nova.compute.manager [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Attaching volume eaf0e61a-7834-4a22-b869-ce73a5145adc to /dev/vdb
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.utils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e32436-a093-40b5-9b3d-a4c16a1073d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f8e5b-a21a-4451-bccf-090daf4e2517]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d859f0b9-af15-4178-9868-e7699925d7a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a1538a-d532-4a7c-9621-c8423034fab3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:03 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19de1205-6f74-404b-97b2-9557b40fc9be]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG os_brick.utils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating existing volume attachment record: 437a1629-c2bc-466b-ba6e-30f2f5ef66fa {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:21:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGxvSRQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:08 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:08 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:08 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6744a1a-f58e-4bc7-9972-455ef795ae37]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:08 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83336ffb-4c8e-44c4-81d4-25ab4ee68ca0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc] added
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[183a6aec-9fbb-4c3e-9ee9-6bcd41ebd8a5]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c132da2a-6c10-447d-a2c7-b387f97fc460]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGxvSRQi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGxvSRQi" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0fda92-799f-4c09-a7bd-1c662479491b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGxvSRQi'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe464a3-ce55-45eb-ac32-fbaab313eb46]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[537c19b4-c4e2-4b79-8759-b0de594c2164]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fb8e4f-c34c-4515-b874-973f369bfd43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260]
Apr 13 20:21:08 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d0f7d-2f3c-4d9c-84bb-39f1a8bc2924]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da903d1-5d64-43f7-a2cd-c6bff5702a9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:08 user nova-compute[71285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)
Apr 13 20:21:08 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f31f8c9-7741-40c5-9eda-e5b653090fdc]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417253.5738482, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:21:08 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Stopped (Lifecycle Event)
Apr 13 20:21:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2ca12508-6145-4fd8-9080-4f42ef8e1022 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:21:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGxvSRQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23234393336366431', 'path': '/dev/sdh'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234393336366431', 'path': '/dev/sdh'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'flavor' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:21:09 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:09 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:09 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:09 user nova-compute[71285]:   <serial>eaf0e61a-7834-4a22-b869-ce73a5145adc</serial>
Apr 13 20:21:09 user nova-compute[71285]: </disk>
Apr 13 20:21:09 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No VIF found with MAC fa:16:3e:9b:45:0e, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2ba74d1c-1d5d-4f06-8848-51504e3ef285 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.629s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-changed-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Refreshing instance network info cache due to event network-changed-3e161dc0-b110-47f1-9a0a-f9add33a394b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Acquiring lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Acquired lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Refreshing network info cache for port 3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417255.7717066, b6fde0f5-70fc-49a5-96f9-b67ed1662a10 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:21:10 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] VM Stopped (Lifecycle Event)
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.objects.instance [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'flavor' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3e29d47b-ce8d-44c6-8323-ef535de1ce81 None None] [instance: b6fde0f5-70fc-49a5-96f9-b67ed1662a10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:10 user nova-compute[71285]: INFO nova.compute.manager [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attaching volume 62f36d4a-1896-4762-a8b9-7d13520c2554 to /dev/vdb
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.utils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd81642-7ef8-47fd-bacd-e6388f2afe0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeea8c2-5d76-4a67-87bb-fc2de687b421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d010cd-47a8-487c-b91b-62d9a41fc928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5ff08f-c454-454f-a75b-661dabe9297d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updated VIF entry in instance network info cache for port 3e161dc0-b110-47f1-9a0a-f9add33a394b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updating instance_info_cache with network_info: [{"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:11 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b089064-6a85-4473-bacf-2b3df94f794e]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-563009e0-d36b-4729-bd20-35b27259514e req-6177e4b1-50c2-4d06-b9ee-8099a0727911 service nova] Releasing lock "refresh_cache-da17669c-1ea2-450a-8183-40b47c4f41fc" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG os_brick.utils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updating existing volume attachment record: f4819899-99f5-4c98-9f1a-f0554a9ea941 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:11 user nova-compute[71285]: INFO nova.compute.manager [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Detaching volume eaf0e61a-7834-4a22-b869-ce73a5145adc
Apr 13 20:21:12 user nova-compute[71285]: INFO nova.virt.block_device [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Attempting to driver detach volume eaf0e61a-7834-4a22-b869-ce73a5145adc from mountpoint /dev/vdb
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Attempting to detach device vdb from instance 0136288f-abaf-4a7c-a878-db415ff98f4b from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:12 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:12 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:12 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:12 user nova-compute[71285]:   <serial>eaf0e61a-7834-4a22-b869-ce73a5145adc</serial>
Apr 13 20:21:12 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:21:12 user nova-compute[71285]: </disk>
Apr 13 20:21:12 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:12 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully detached device vdb from instance 0136288f-abaf-4a7c-a878-db415ff98f4b from the persistent domain config.
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0136288f-abaf-4a7c-a878-db415ff98f4b from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:12 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:12 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:12 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:12 user nova-compute[71285]:   <serial>eaf0e61a-7834-4a22-b869-ce73a5145adc</serial>
Apr 13 20:21:12 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:21:12 user nova-compute[71285]: </disk>
Apr 13 20:21:12 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417272.49399, 0136288f-abaf-4a7c-a878-db415ff98f4b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:21:12 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully detached device vdb from instance 0136288f-abaf-4a7c-a878-db415ff98f4b from the live domain config.
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGxvSRQi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:12 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e110f474-3c49-4686-9035-18ff40237f03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:12 user nova-compute[71285]: No targets found.
Apr 13 20:21:12 user nova-compute[71285]: iSNS:
Apr 13 20:21:12 user nova-compute[71285]: No targets found.
Apr 13 20:21:12 user nova-compute[71285]: STATIC:
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:12 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:12 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:12 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:12 user nova-compute[71285]: No targets found.
Apr 13 20:21:12 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:12 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:12 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0827320-e567-4dfa-a4b4-dec7930bbd63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b43fa2c-f2bb-4f8b-920a-2da69ba98852]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)
Apr 13 20:21:12 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:12 user nova-compute[71285]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc (non-flash)
Apr 13 20:21:12 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70b76710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc'): ({'sdh'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Removing single pathed devices sdh {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[382a1334-1ca0-4b76-93e9-76bb693750ad]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137a247-750a-4bfd-bdd5-f72c2b50ba8f]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flushing IO for device /dev/sdh {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66d1339-a69e-4e7c-8664-4fab67637627]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c12f0-65e9-4e30-9bd2-f33ecf913fa5]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bbd33f-3abe-4124-a379-4784eb1a1423]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e1a5e-c964-4d02-95de-6284e9e09897]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260]
Apr 13 20:21:12 user nova-compute[71285]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:12 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaf0e61a-7834-4a22-b869-ce73a5145adc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93217e-2d30-425d-afaf-b4934b114317]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] <== disconnect_volume: return (324ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-changed-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Refreshing instance network info cache due to event network-changed-80e7738a-fc24-4b82-b70b-ae85ea74545f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Acquiring lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Acquired lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Refreshing network info cache for port 80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'flavor' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8b348aa5-68eb-4ba5-ab53-e2c77971ae89 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.843s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updated VIF entry in instance network info cache for port 80e7738a-fc24-4b82-b70b-ae85ea74545f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG nova.network.neutron [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating instance_info_cache with network_info: [{"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7b9b1df4-671b-4ab0-98b0-e174f89cad5f req-8ced4f80-fffb-480b-af1e-831aea206809 service nova] Releasing lock "refresh_cache-c936eb14-b16e-46fb-9e39-5ba49da4fb73" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:14 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'flavor' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:15 user nova-compute[71285]: INFO nova.compute.manager [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Attaching volume 6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc to /dev/sdc
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.utils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd431f8d-ebbf-4661-855a-45c2ad3dbbb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd1e77-26ad-4868-a9b7-c950cebbabb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b298c6-a624-4576-ace7-a282e3374cf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8446f-5ffc-419a-b863-163664c82544]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:15 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce796325-f806-4815-843b-8bc7d5b43b5c]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.utils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating existing volume attachment record: 6a54b4a9-79fb-4ea2-8a00-ceddccb6aac5 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:15 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:15 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:15 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b309abe4-06f6-49fc-8b1a-9ed0d4f9c154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:15 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f357e0-d268-49d6-bae7-9849a911782e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554] added
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9a877-c7ba-416d-beb3-3363bf49681a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82d12ab-2703-42ca-b1f4-fa928f079ffe]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awrEjMGp {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awrEjMGp" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da432316-cae5-4712-b926-03d78e15b167]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awrEjMGp'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63384f49-a46b-4a17-92cd-db1b8e7c2a49]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8384cb-1aca-44a3-a80d-fa4005c67de1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86efb5c-0959-44b3-965e-a3419e1fb976]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]
Apr 13 20:21:16 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326c12f-c53f-4352-a781-31ae92206116]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e13bd2-2e34-4a8d-a932-8fa9d8cdbf63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:16 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95053528-e761-4418-ba64-ea253905b3c8]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-changed-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing instance network info cache due to event network-changed-3ac07688-57a6-45c2-9b2c-eea32bc1e446. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing network info cache for port 3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.network.neutron [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updated VIF entry in instance network info cache for port 3ac07688-57a6-45c2-9b2c-eea32bc1e446. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.network.neutron [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-35e26ac0-9d75-4fe8-a98f-6e6214d2a12e req-4cda5737-fbfe-45de-96c3-56c69143d64a service nova] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26366316531326332', 'path': '/dev/sdh'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366316531326332', 'path': '/dev/sdh'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'flavor' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:21:17 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:17 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:17 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:17 user nova-compute[71285]:   <serial>62f36d4a-1896-4762-a8b9-7d13520c2554</serial>
Apr 13 20:21:17 user nova-compute[71285]: </disk>
Apr 13 20:21:17 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'pci_requests' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.policy [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4274e07dcb15438689444331f895ca18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10892937e6784f7bab0a6e5d835f9009', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] No VIF found with MAC fa:16:3e:e4:c4:8f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:21:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-be3f33d8-6345-48f4-8794-fe67b366bb07 tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.918s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Successfully created port: 210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Successfully updated port: 210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-changed-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing instance network info cache due to event network-changed-210d0fac-6751-4e8b-8d57-2ca9b09fdef9. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.utils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e008a8a1-1141-49d3-9060-cc7ae597b76a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[265687c0-193f-4181-8d38-aa0d68dfc559]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfb17f9-0c6a-4358-9781-7965d65dfa19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da16a53-d911-4a9f-b0bd-08bcd09e2c60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:19 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8897c123-f73b-44ec-a297-81e774385951]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.utils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:19 user nova-compute[71285]: INFO nova.compute.manager [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Swapping volume 62f36d4a-1896-4762-a8b9-7d13520c2554 for ed1aba59-6db5-47a3-bb7d-d1c2d80027b8
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Refreshing network info cache for port 210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_vif [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap210d0fac-67, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap210d0fac-67, col_values=(('external_ids', {'iface-id': '210d0fac-6751-4e8b-8d57-2ca9b09fdef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:4b:ca', 'vm-uuid': 'a78111f4-fcd5-4efc-977e-d8d32225c83f'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: INFO os_vif [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67')
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] attach device xml: <interface type="ethernet">
Apr 13 20:21:19 user nova-compute[71285]:   <mac address="fa:16:3e:58:4b:ca"/>
Apr 13 20:21:19 user nova-compute[71285]:   <model type="virtio"/>
Apr 13 20:21:19 user nova-compute[71285]:   <mtu size="1442"/>
Apr 13 20:21:19 user nova-compute[71285]:   <target dev="tap210d0fac-67"/>
Apr 13 20:21:19 user nova-compute[71285]: </interface>
Apr 13 20:21:19 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKaAIwZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:19 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:19 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:19 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b248fe8a-10ea-4cb8-b0f6-fac470877b7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:19 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f9b70b-409d-4b54-aed0-ab108b3bd581]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc] added
Apr 13 20:21:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23d6f1-58b6-476f-81bf-4ce20d75b87d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1ed47-d590-4e73-89c8-abb8fe3b5fb0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKaAIwZx {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:19 user nova-compute[71285]: WARNING nova.compute.manager [req-a8cae435-0fe6-4acc-b865-dabd08e9262d req-c9157194-04c6-4da3-95b8-10dab2891764 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance with vm_state active and task_state None.
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKaAIwZx" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[220145b7-7dfb-47fd-891b-2f0d621bce4b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKaAIwZx'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34da32-3d86-4215-954a-319863029f98]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name hda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No VIF found with MAC fa:16:3e:0c:9f:f0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a042f5c1-1bd6-4d65-8181-035d3649d710]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:20 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:20</nova:creationTime>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:20 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:20 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:20 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:20 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:20 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:20 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:20 user nova-compute[71285]:     <nova:port uuid="210d0fac-6751-4e8b-8d57-2ca9b09fdef9">
Apr 13 20:21:20 user nova-compute[71285]:       <nova:ip type="fixed" address="10.10.10.73" ipVersion="4"/>
Apr 13 20:21:20 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:20 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:20 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:20 user nova-compute[71285]:  {{(pid=71285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG nova.network.neutron [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updated VIF entry in instance network info cache for port 210d0fac-6751-4e8b-8d57-2ca9b09fdef9. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG nova.network.neutron [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e3189437-e0f5-4470-92b7-5d91ced396c3 req-933809a1-511d-4b1f-8045-f16d3e746538 service nova] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5b45df1-80d6-408c-bb8a-2b02fa6ed5f9 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.945s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b718ef34-f1dc-4079-9249-94bb6c62c09f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260]
Apr 13 20:21:20 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9017ae-73c8-4cba-87ad-53763083206d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83116c6d-5a42-4225-89f4-d3a9b6b6fd6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:20 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f14f9-806a-4c03-bd54-07f63e094404]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKaAIwZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG nova.objects.instance [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:20 user nova-compute[71285]: INFO nova.compute.manager [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Attaching volume cb60aedd-5274-4ec7-8860-df6be02fcd12 to /dev/vdb
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.utils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a006f3-fb7f-4320-97e7-66eea7b7caf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[416be742-806a-404e-8371-7e7ba5dd9291]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[faac2279-c2d8-4e16-9cd6-99ed52ded786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba17470-8eee-4c30-a5d7-99c792c4c26c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:20 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec6597-b05c-498a-8b51-85c84c9a347d]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG os_brick.utils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:20 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating existing volume attachment record: d38fc303-f5a1-4f3c-a446-ac9c783989e2 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26366343238643531', 'path': '/dev/sdi'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366343238643531', 'path': '/dev/sdi'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'flavor' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:21:21 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:21 user nova-compute[71285]:   <source dev="/dev/sdi"/>
Apr 13 20:21:21 user nova-compute[71285]:   <target dev="sdc" bus="scsi"/>
Apr 13 20:21:21 user nova-compute[71285]:   <serial>6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc</serial>
Apr 13 20:21:21 user nova-compute[71285]:   <address type="drive" controller="0" unit="2"/>
Apr 13 20:21:21 user nova-compute[71285]: </disk>
Apr 13 20:21:21 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No BDM found with device name sda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] No VIF found with MAC fa:16:3e:99:9b:cb, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:21:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8af2d94d-9079-4f42-ad1f-63211d725894 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.702s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:22 user nova-compute[71285]: WARNING nova.compute.manager [req-3aee9abd-0dd2-464c-8435-79b2386e6539 req-209a9d9e-dc95-47d3-b265-edcfc09e575a service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance with vm_state active and task_state None.
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:23 user nova-compute[71285]: INFO nova.compute.manager [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Detaching volume 6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc
Apr 13 20:21:23 user nova-compute[71285]: INFO nova.virt.block_device [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Attempting to driver detach volume 6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc from mountpoint /dev/sdc
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Attempting to detach device sdc from instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:23 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:23 user nova-compute[71285]:   <source dev="/dev/sdi"/>
Apr 13 20:21:23 user nova-compute[71285]:   <target dev="sdc" bus="scsi"/>
Apr 13 20:21:23 user nova-compute[71285]:   <serial>6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc</serial>
Apr 13 20:21:23 user nova-compute[71285]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 20:21:23 user nova-compute[71285]: </disk>
Apr 13 20:21:23 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Successfully detached device sdc from instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 from the persistent domain config.
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:23 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:23 user nova-compute[71285]:   <source dev="/dev/sdi"/>
Apr 13 20:21:23 user nova-compute[71285]:   <target dev="sdc" bus="scsi"/>
Apr 13 20:21:23 user nova-compute[71285]:   <serial>6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc</serial>
Apr 13 20:21:23 user nova-compute[71285]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 13 20:21:23 user nova-compute[71285]: </disk>
Apr 13 20:21:23 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417283.5547874, c936eb14-b16e-46fb-9e39-5ba49da4fb73 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:21:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Successfully detached device sdc from instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 from the live domain config.
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKaAIwZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb199e6b-20ed-4961-9bd9-eccf92572a81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:23 user nova-compute[71285]: No targets found.
Apr 13 20:21:23 user nova-compute[71285]: iSNS:
Apr 13 20:21:23 user nova-compute[71285]: No targets found.
Apr 13 20:21:23 user nova-compute[71285]: STATIC:
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:23 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:23 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:23 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:23 user nova-compute[71285]: No targets found.
Apr 13 20:21:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:23 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:23 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bfd2a8-0594-49ed-a88f-1fa49590e7b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[855646ed-bbc6-43a4-afd4-2333eb119c52]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:23 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc'): ({'sdi'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Removing single pathed devices sdi {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2234d-b12d-497e-8f06-b44fe622890e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d25a5c4-433a-4b12-bc45-0e7883178698]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Flushing IO for device /dev/sdi {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc846b7-e983-44c0-b4d3-ef73229ced9b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbfa0f8-dead-4cce-befb-02e432186f79]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] SCSI volumes sdi have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b1521-222b-4219-8b13-1324d719110b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'serial': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': '62f36d4a-1896-4762-a8b9-7d13520c2554', 'serial'} {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc715487-9ca5-44dc-aca7-3c0ad4377f9e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260]
Apr 13 20:21:23 user nova-compute[71285]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6eecf2ec-4fc2-40d8-b0ef-a3f646ddc3dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd100d8-0d52-458b-831b-214d91a1ef3d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] <== disconnect_volume: return (369ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.045s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:23 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e430624d-a6a3-4c34-b730-f9e782bd1343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[deafe3ce-9650-49ef-a0ed-34184fb0765a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8] added
Apr 13 20:21:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[874311bb-2eb0-4793-a388-b1f6b4d39a94]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ff0584-3f54-4246-9942-aa6ecaa7dfa9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRbuIAiW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRbuIAiW" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4e5fbc-0b01-4567-8ec9-ca898ed39db5]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRbuIAiW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26c867f-2dbc-4c35-ac2d-afa3447c49f7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a85f96-c300-447c-a8ad-99ab5340b37c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbe248a-9849-49c2-b06a-1d976e364087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260]
Apr 13 20:21:24 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f964283d-d33d-4865-a475-b9dd3bf52ed9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294d8d7-30c0-4682-a526-847aaee741e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:24 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] HCTL ('40', '-', '-', 0) found on session 12 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2162b-d1aa-48f4-adb9-de3a1ca599d8]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Searching for a device in session 12 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'flavor' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-64b51db8-a04f-49b9-9484-bd136a2c3697 tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBCbJhaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26537393065666533', 'path': '/dev/sdi'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537393065666533', 'path': '/dev/sdi'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.021s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:25 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lazy-loading 'flavor' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec8f614-6c23-4212-bec6-58976a378640]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:25 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8da889-6488-463b-ae3b-2c33fac0c5ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12] added
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644d525-80ec-46a5-bdd8-ae74d9a996ee]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a5b648-3593-4e34-87ef-9c3f9e386c50]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBCbJhaQ {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBCbJhaQ" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e2579-baab-4549-99d8-f36ad72009c2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBCbJhaQ'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c78b5-093a-4047-a495-1575cfe33d0c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742f134-39a4-4ad9-a6dc-4ab1c90622e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[389ab3f6-6630-418a-a75e-c15649d5b945]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260]
Apr 13 20:21:25 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:25 user nova-compute[71285]: INFO nova.compute.manager [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Terminating instance
Apr 13 20:21:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6752ed7-ecd3-46d9-bf98-d1bec3bf94ec]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c480501-fac5-4fbe-8d44-fa7e0f417d10]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:25 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[84056c5b-30b4-412e-b90d-7efae2df8e28]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBCbJhaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 159383552 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-unplugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] No waiting events found dispatching network-vif-unplugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-88dbbd52-8b89-400f-a57b-46f99e456f4b req-a2f58c8b-2acf-4c10-86ba-de54c0063459 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-unplugged-80e7738a-fc24-4b82-b70b-ae85ea74545f for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Instance destroyed successfully.
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lazy-loading 'resources' on Instance uuid c936eb14-b16e-46fb-9e39-5ba49da4fb73 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-569327851',display_name='tempest-AttachSCSIVolumeTestJSON-server-569327851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-569327851',id=6,image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUdmP1CY8bdTh8IXDrsiI4+sMDfwgwwFraKNk8459+0r49Q9ABneRe4MPsuQ/EiitrvDfvuzfptfBBU8iwJnxppZYB6l8MvGtaZ90NTqGXOPbE8oGQStKt+DK5t1pV+Hg==',key_name='tempest-keypair-964773546',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2fff2eec2af433e9699cbc5be23e80e',ramdisk_id='',reservation_id='r-0y9mgp1n',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f1c9d799-549d-45fe-975d-6271934a1df9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1525127673',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1525127673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02540e30946f4e5c844c1e8f260e4728',uuid=c936eb14-b16e-46fb-9e39-5ba49da4fb73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converting VIF {"id": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "address": "fa:16:3e:99:9b:cb", "network": {"id": "3e979e57-12db-42a3-95d7-aa85f8c622da", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1283092786-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2fff2eec2af433e9699cbc5be23e80e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80e7738a-fc", "ovs_interfaceid": "80e7738a-fc24-4b82-b70b-ae85ea74545f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG os_vif [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80e7738a-fc, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:26 user nova-compute[71285]: INFO os_vif [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:9b:cb,bridge_name='br-int',has_traffic_filtering=True,id=80e7738a-fc24-4b82-b70b-ae85ea74545f,network=Network(3e979e57-12db-42a3-95d7-aa85f8c622da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80e7738a-fc')
Apr 13 20:21:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Deleting instance files /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73_del
Apr 13 20:21:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Deletion of /opt/stack/data/nova/instances/c936eb14-b16e-46fb-9e39-5ba49da4fb73_del complete
Apr 13 20:21:26 user nova-compute[71285]: INFO nova.compute.manager [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 13 20:21:26 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23034393464396362', 'path': '/dev/sdj'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034393464396362', 'path': '/dev/sdj'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:21:26 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:26 user nova-compute[71285]:   <source dev="/dev/sdj"/>
Apr 13 20:21:26 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:26 user nova-compute[71285]:   <serial>cb60aedd-5274-4ec7-8860-df6be02fcd12</serial>
Apr 13 20:21:26 user nova-compute[71285]: </disk>
Apr 13 20:21:26 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:21:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 331350016 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No BDM found with device name hda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] No VIF found with MAC fa:16:3e:0c:9f:f0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 511705088 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-512b35a1-ede1-46cf-9c2f-5e3167faec88 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.932s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 661651456 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-deleted-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:28 user nova-compute[71285]: INFO nova.compute.manager [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Neutron deleted interface 80e7738a-fc24-4b82-b70b-ae85ea74545f; detaching it from the instance and deleting it from the info cache
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.network.neutron [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:28 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Took 1.41 seconds to deallocate network for instance.
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-e49a63cf-c297-420e-bbad-d974be6c047a req-d1475aaa-0fe5-4839-98d7-780f91542f0f service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Detach interface failed, port_id=80e7738a-fc24-4b82-b70b-ae85ea74545f, reason: Instance c936eb14-b16e-46fb-9e39-5ba49da4fb73 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Acquiring lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] No waiting events found dispatching network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:28 user nova-compute[71285]: WARNING nova.compute.manager [req-af2c14d4-635e-4d22-b250-ae79cb347e86 req-d5d5cb69-a1da-4a00-9f8c-142d869f1ae1 service nova] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Received unexpected event network-vif-plugged-80e7738a-fc24-4b82-b70b-ae85ea74545f for instance with vm_state deleted and task_state None.
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:28 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Deleted allocations for instance c936eb14-b16e-46fb-9e39-5ba49da4fb73
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e0750cad-71dd-44fb-9125-ea7726e16a5f tempest-AttachSCSIVolumeTestJSON-1525127673 tempest-AttachSCSIVolumeTestJSON-1525127673-project-member] Lock "c936eb14-b16e-46fb-9e39-5ba49da4fb73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.172s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 1003487232 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:28 user nova-compute[71285]: INFO nova.compute.manager [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Detaching volume cb60aedd-5274-4ec7-8860-df6be02fcd12
Apr 13 20:21:29 user nova-compute[71285]: INFO nova.virt.block_device [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Attempting to driver detach volume cb60aedd-5274-4ec7-8860-df6be02fcd12 from mountpoint /dev/vdb
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Attempting to detach device vdb from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:29 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:29 user nova-compute[71285]:   <source dev="/dev/sdj"/>
Apr 13 20:21:29 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:29 user nova-compute[71285]:   <serial>cb60aedd-5274-4ec7-8860-df6be02fcd12</serial>
Apr 13 20:21:29 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 20:21:29 user nova-compute[71285]: </disk>
Apr 13 20:21:29 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully detached device vdb from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the persistent domain config.
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:29 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:29 user nova-compute[71285]:   <source dev="/dev/sdj"/>
Apr 13 20:21:29 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:29 user nova-compute[71285]:   <serial>cb60aedd-5274-4ec7-8860-df6be02fcd12</serial>
Apr 13 20:21:29 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 20:21:29 user nova-compute[71285]: </disk>
Apr 13 20:21:29 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417289.4947975, a78111f4-fcd5-4efc-977e-d8d32225c83f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:21:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully detached device vdb from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the live domain config.
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBCbJhaQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:29 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34d223a-f6ba-49c5-89ff-aa45ac2d4efd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]: iSNS:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]: STATIC:
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:29 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:29 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:29 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1244556-3a51-4a75-8f85-4c87d76a7c54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c76494-8cb1-4aa5-8feb-08f8298df787]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6d890dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12'): ({'sdj'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Removing single pathed devices sdj {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[926877cc-f56e-4d30-9ee6-00f3a1374783]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bc77be-43ed-4db6-980f-e84a28163127]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Flushing IO for device /dev/sdj {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4920cfab-d71b-48e7-9bc0-dc94852496d9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[507209a3-d802-42a6-ae66-8289fadc6c13]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] SCSI volumes sdj have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf13355-14d1-4bcf-ac89-c4a805137fbf]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e711a8-9b24-4050-ad12-bba3704c3d1f]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260]
Apr 13 20:21:29 user nova-compute[71285]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb60aedd-5274-4ec7-8860-df6be02fcd12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d79bbf-ef49-486e-a644-838008b355af]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] <== disconnect_volume: return (324ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.280s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74d5c3-e52c-42ed-a2e9-e94e6801fdae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]: iSNS:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]: STATIC:
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:29 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:29 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:29 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:29 user nova-compute[71285]: No targets found.
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:29 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:29 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d1195-c30c-4437-bb04-496834bb19a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14540d63-44a8-4bad-8ade-4b4b2ddc07c6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:29 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554'): ({'sdh'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Removing single pathed devices sdh {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce5fc6e-eb9a-4015-8604-dd038c5e31f3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3f08e9-c3d6-4f36-a3ad-76e5aca0008f]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Flushing IO for device /dev/sdh {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[40325086-641c-474a-ab26-d18cda435149]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ca9d31-02b8-4489-8f3e-f47dccebb71f]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5564ae-d2ba-4220-ac98-4cbbc4d1f409]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe7c37-6653-443b-a086-1a13a445a469]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]
Apr 13 20:21:30 user nova-compute[71285]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9037ae8-ebb3-4509-88f1-958ea74ddef6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== disconnect_volume: return (643ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'serial'} {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: removing Cinder connection for volume 62f36d4a-1896-4762-a8b9-7d13520c2554 {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4f843d5-1389-4db8-8a1c-cb47a0c747c3 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.990s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: Updating volume 62f36d4a-1896-4762-a8b9-7d13520c2554 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BRbuIAiW", "auth_password": "iTFHkmedvtP398", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "ed1aba59-6db5-47a3-bb7d-d1c2d80027b8"}, "status": "reserved", "instance": "da17669c-1ea2-450a-8183-40b47c4f41fc", "attached_at": "", "detached_at": "", "volume_id": "ed1aba59-6db5-47a3-bb7d-d1c2d80027b8", "serial": "ed1aba59-6db5-47a3-bb7d-d1c2d80027b8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'no_device': None, 'attachment_id': 'd4d477de-e7d6-4337-9efe-69e47ea70ee7'} {{(pid=71285) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1fac568f-b1de-49ab-a4e7-1c51fd43f990 tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.059s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-210d0fac-6751-4e8b-8d57-2ca9b09fdef9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-210d0fac-6751-4e8b-8d57-2ca9b09fdef9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.objects.instance [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Attempting to detach device tap210d0fac-67 from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] detach device xml: <interface type="ethernet">
Apr 13 20:21:31 user nova-compute[71285]:   <mac address="fa:16:3e:58:4b:ca"/>
Apr 13 20:21:31 user nova-compute[71285]:   <model type="virtio"/>
Apr 13 20:21:31 user nova-compute[71285]:   <mtu size="1442"/>
Apr 13 20:21:31 user nova-compute[71285]:   <target dev="tap210d0fac-67"/>
Apr 13 20:21:31 user nova-compute[71285]: </interface>
Apr 13 20:21:31 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 13 20:21:31 user nova-compute[71285]:   <name>instance-00000007</name>
Apr 13 20:21:31 user nova-compute[71285]:   <uuid>a78111f4-fcd5-4efc-977e-d8d32225c83f</uuid>
Apr 13 20:21:31 user nova-compute[71285]:   <metadata>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:31 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:20</nova:creationTime>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:31 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:31 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:31 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:port uuid="210d0fac-6751-4e8b-8d57-2ca9b09fdef9">
Apr 13 20:21:31 user nova-compute[71285]:       <nova:ip type="fixed" address="10.10.10.73" ipVersion="4"/>
Apr 13 20:21:31 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:31 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:31 user nova-compute[71285]:   </metadata>
Apr 13 20:21:31 user nova-compute[71285]:   <memory unit='KiB'>131072</memory>
Apr 13 20:21:31 user nova-compute[71285]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 20:21:31 user nova-compute[71285]:   <vcpu placement='static'>1</vcpu>
Apr 13 20:21:31 user nova-compute[71285]:   <resource>
Apr 13 20:21:31 user nova-compute[71285]:     <partition>/machine</partition>
Apr 13 20:21:31 user nova-compute[71285]:   </resource>
Apr 13 20:21:31 user nova-compute[71285]:   <sysinfo type='smbios'>
Apr 13 20:21:31 user nova-compute[71285]:     <system>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='version'>0.0.0</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='serial'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='uuid'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='family'>Virtual Machine</entry>
Apr 13 20:21:31 user nova-compute[71285]:     </system>
Apr 13 20:21:31 user nova-compute[71285]:   </sysinfo>
Apr 13 20:21:31 user nova-compute[71285]:   <os>
Apr 13 20:21:31 user nova-compute[71285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 20:21:31 user nova-compute[71285]:     <boot dev='hd'/>
Apr 13 20:21:31 user nova-compute[71285]:     <smbios mode='sysinfo'/>
Apr 13 20:21:31 user nova-compute[71285]:   </os>
Apr 13 20:21:31 user nova-compute[71285]:   <features>
Apr 13 20:21:31 user nova-compute[71285]:     <acpi/>
Apr 13 20:21:31 user nova-compute[71285]:     <apic/>
Apr 13 20:21:31 user nova-compute[71285]:     <vmcoreinfo state='on'/>
Apr 13 20:21:31 user nova-compute[71285]:   </features>
Apr 13 20:21:31 user nova-compute[71285]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 20:21:31 user nova-compute[71285]:     <model fallback='forbid'>Nehalem</model>
Apr 13 20:21:31 user nova-compute[71285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='vme'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='x2apic'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='hypervisor'/>
Apr 13 20:21:31 user nova-compute[71285]:   </cpu>
Apr 13 20:21:31 user nova-compute[71285]:   <clock offset='utc'>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='hpet' present='no'/>
Apr 13 20:21:31 user nova-compute[71285]:   </clock>
Apr 13 20:21:31 user nova-compute[71285]:   <on_poweroff>destroy</on_poweroff>
Apr 13 20:21:31 user nova-compute[71285]:   <on_reboot>restart</on_reboot>
Apr 13 20:21:31 user nova-compute[71285]:   <on_crash>destroy</on_crash>
Apr 13 20:21:31 user nova-compute[71285]:   <devices>
Apr 13 20:21:31 user nova-compute[71285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 20:21:31 user nova-compute[71285]:     <disk type='file' device='disk'>
Apr 13 20:21:31 user nova-compute[71285]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 20:21:31 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk' index='2'/>
Apr 13 20:21:31 user nova-compute[71285]:       <backingStore type='file' index='3'>
Apr 13 20:21:31 user nova-compute[71285]:         <format type='raw'/>
Apr 13 20:21:31 user nova-compute[71285]:         <source file='/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2'/>
Apr 13 20:21:31 user nova-compute[71285]:         <backingStore/>
Apr 13 20:21:31 user nova-compute[71285]:       </backingStore>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='vda' bus='virtio'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='virtio-disk0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </disk>
Apr 13 20:21:31 user nova-compute[71285]:     <disk type='file' device='cdrom'>
Apr 13 20:21:31 user nova-compute[71285]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 20:21:31 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config' index='1'/>
Apr 13 20:21:31 user nova-compute[71285]:       <backingStore/>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='hda' bus='ide'/>
Apr 13 20:21:31 user nova-compute[71285]:       <readonly/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='ide0-0-0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </disk>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='usb' index='0' model='none'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='usb'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='pci.0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='ide' index='0'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='ide'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <interface type='ethernet'>
Apr 13 20:21:31 user nova-compute[71285]:       <mac address='fa:16:3e:0c:9f:f0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='tap3ac07688-57'/>
Apr 13 20:21:31 user nova-compute[71285]:       <model type='virtio'/>
Apr 13 20:21:31 user nova-compute[71285]:       <mtu size='1442'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='net0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </interface>
Apr 13 20:21:31 user nova-compute[71285]:     <interface type='ethernet'>
Apr 13 20:21:31 user nova-compute[71285]:       <mac address='fa:16:3e:58:4b:ca'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='tap210d0fac-67'/>
Apr 13 20:21:31 user nova-compute[71285]:       <model type='virtio'/>
Apr 13 20:21:31 user nova-compute[71285]:       <mtu size='1442'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='net1'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </interface>
Apr 13 20:21:31 user nova-compute[71285]:     <serial type='pty'>
Apr 13 20:21:31 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:31 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target type='isa-serial' port='0'>
Apr 13 20:21:31 user nova-compute[71285]:         <model name='isa-serial'/>
Apr 13 20:21:31 user nova-compute[71285]:       </target>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </serial>
Apr 13 20:21:31 user nova-compute[71285]:     <console type='pty' tty='/dev/pts/6'>
Apr 13 20:21:31 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:31 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target type='serial' port='0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </console>
Apr 13 20:21:31 user nova-compute[71285]:     <input type='mouse' bus='ps2'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='input0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </input>
Apr 13 20:21:31 user nova-compute[71285]:     <input type='keyboard' bus='ps2'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='input1'/>
Apr 13 20:21:31 user nova-compute[71285]:     </input>
Apr 13 20:21:31 user nova-compute[71285]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 20:21:31 user nova-compute[71285]:       <listen type='address' address='0.0.0.0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </graphics>
Apr 13 20:21:31 user nova-compute[71285]:     <audio id='1' type='none'/>
Apr 13 20:21:31 user nova-compute[71285]:     <video>
Apr 13 20:21:31 user nova-compute[71285]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='video0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </video>
Apr 13 20:21:31 user nova-compute[71285]:     <memballoon model='virtio'>
Apr 13 20:21:31 user nova-compute[71285]:       <stats period='10'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='balloon0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </memballoon>
Apr 13 20:21:31 user nova-compute[71285]:     <rng model='virtio'>
Apr 13 20:21:31 user nova-compute[71285]:       <backend model='random'>/dev/urandom</backend>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='rng0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </rng>
Apr 13 20:21:31 user nova-compute[71285]:   </devices>
Apr 13 20:21:31 user nova-compute[71285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 20:21:31 user nova-compute[71285]:     <label>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</label>
Apr 13 20:21:31 user nova-compute[71285]:     <imagelabel>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</imagelabel>
Apr 13 20:21:31 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:31 user nova-compute[71285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 20:21:31 user nova-compute[71285]:     <label>+64055:+108</label>
Apr 13 20:21:31 user nova-compute[71285]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 20:21:31 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:31 user nova-compute[71285]: </domain>
Apr 13 20:21:31 user nova-compute[71285]:  {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 20:21:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully detached device tap210d0fac-67 from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the persistent domain config.
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] (1/8): Attempting to detach device tap210d0fac-67 with device alias net1 from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] detach device xml: <interface type="ethernet">
Apr 13 20:21:31 user nova-compute[71285]:   <mac address="fa:16:3e:58:4b:ca"/>
Apr 13 20:21:31 user nova-compute[71285]:   <model type="virtio"/>
Apr 13 20:21:31 user nova-compute[71285]:   <mtu size="1442"/>
Apr 13 20:21:31 user nova-compute[71285]:   <target dev="tap210d0fac-67"/>
Apr 13 20:21:31 user nova-compute[71285]: </interface>
Apr 13 20:21:31 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417291.6785553, a78111f4-fcd5-4efc-977e-d8d32225c83f => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Start waiting for the detach event from libvirt for device tap210d0fac-67 with device alias net1 for instance a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 13 20:21:31 user nova-compute[71285]:   <name>instance-00000007</name>
Apr 13 20:21:31 user nova-compute[71285]:   <uuid>a78111f4-fcd5-4efc-977e-d8d32225c83f</uuid>
Apr 13 20:21:31 user nova-compute[71285]:   <metadata>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:31 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:20</nova:creationTime>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:31 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:31 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:31 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:port uuid="210d0fac-6751-4e8b-8d57-2ca9b09fdef9">
Apr 13 20:21:31 user nova-compute[71285]:       <nova:ip type="fixed" address="10.10.10.73" ipVersion="4"/>
Apr 13 20:21:31 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:31 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:31 user nova-compute[71285]:   </metadata>
Apr 13 20:21:31 user nova-compute[71285]:   <memory unit='KiB'>131072</memory>
Apr 13 20:21:31 user nova-compute[71285]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 20:21:31 user nova-compute[71285]:   <vcpu placement='static'>1</vcpu>
Apr 13 20:21:31 user nova-compute[71285]:   <resource>
Apr 13 20:21:31 user nova-compute[71285]:     <partition>/machine</partition>
Apr 13 20:21:31 user nova-compute[71285]:   </resource>
Apr 13 20:21:31 user nova-compute[71285]:   <sysinfo type='smbios'>
Apr 13 20:21:31 user nova-compute[71285]:     <system>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='version'>0.0.0</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='serial'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='uuid'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:31 user nova-compute[71285]:       <entry name='family'>Virtual Machine</entry>
Apr 13 20:21:31 user nova-compute[71285]:     </system>
Apr 13 20:21:31 user nova-compute[71285]:   </sysinfo>
Apr 13 20:21:31 user nova-compute[71285]:   <os>
Apr 13 20:21:31 user nova-compute[71285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 20:21:31 user nova-compute[71285]:     <boot dev='hd'/>
Apr 13 20:21:31 user nova-compute[71285]:     <smbios mode='sysinfo'/>
Apr 13 20:21:31 user nova-compute[71285]:   </os>
Apr 13 20:21:31 user nova-compute[71285]:   <features>
Apr 13 20:21:31 user nova-compute[71285]:     <acpi/>
Apr 13 20:21:31 user nova-compute[71285]:     <apic/>
Apr 13 20:21:31 user nova-compute[71285]:     <vmcoreinfo state='on'/>
Apr 13 20:21:31 user nova-compute[71285]:   </features>
Apr 13 20:21:31 user nova-compute[71285]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 20:21:31 user nova-compute[71285]:     <model fallback='forbid'>Nehalem</model>
Apr 13 20:21:31 user nova-compute[71285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='vme'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='x2apic'/>
Apr 13 20:21:31 user nova-compute[71285]:     <feature policy='require' name='hypervisor'/>
Apr 13 20:21:31 user nova-compute[71285]:   </cpu>
Apr 13 20:21:31 user nova-compute[71285]:   <clock offset='utc'>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 20:21:31 user nova-compute[71285]:     <timer name='hpet' present='no'/>
Apr 13 20:21:31 user nova-compute[71285]:   </clock>
Apr 13 20:21:31 user nova-compute[71285]:   <on_poweroff>destroy</on_poweroff>
Apr 13 20:21:31 user nova-compute[71285]:   <on_reboot>restart</on_reboot>
Apr 13 20:21:31 user nova-compute[71285]:   <on_crash>destroy</on_crash>
Apr 13 20:21:31 user nova-compute[71285]:   <devices>
Apr 13 20:21:31 user nova-compute[71285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 20:21:31 user nova-compute[71285]:     <disk type='file' device='disk'>
Apr 13 20:21:31 user nova-compute[71285]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 20:21:31 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk' index='2'/>
Apr 13 20:21:31 user nova-compute[71285]:       <backingStore type='file' index='3'>
Apr 13 20:21:31 user nova-compute[71285]:         <format type='raw'/>
Apr 13 20:21:31 user nova-compute[71285]:         <source file='/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2'/>
Apr 13 20:21:31 user nova-compute[71285]:         <backingStore/>
Apr 13 20:21:31 user nova-compute[71285]:       </backingStore>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='vda' bus='virtio'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='virtio-disk0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </disk>
Apr 13 20:21:31 user nova-compute[71285]:     <disk type='file' device='cdrom'>
Apr 13 20:21:31 user nova-compute[71285]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 20:21:31 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config' index='1'/>
Apr 13 20:21:31 user nova-compute[71285]:       <backingStore/>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='hda' bus='ide'/>
Apr 13 20:21:31 user nova-compute[71285]:       <readonly/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='ide0-0-0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </disk>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='usb' index='0' model='none'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='usb'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='pci.0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <controller type='ide' index='0'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='ide'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 20:21:31 user nova-compute[71285]:     </controller>
Apr 13 20:21:31 user nova-compute[71285]:     <interface type='ethernet'>
Apr 13 20:21:31 user nova-compute[71285]:       <mac address='fa:16:3e:0c:9f:f0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target dev='tap3ac07688-57'/>
Apr 13 20:21:31 user nova-compute[71285]:       <model type='virtio'/>
Apr 13 20:21:31 user nova-compute[71285]:       <mtu size='1442'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='net0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </interface>
Apr 13 20:21:31 user nova-compute[71285]:     <serial type='pty'>
Apr 13 20:21:31 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:31 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target type='isa-serial' port='0'>
Apr 13 20:21:31 user nova-compute[71285]:         <model name='isa-serial'/>
Apr 13 20:21:31 user nova-compute[71285]:       </target>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </serial>
Apr 13 20:21:31 user nova-compute[71285]:     <console type='pty' tty='/dev/pts/6'>
Apr 13 20:21:31 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:31 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:31 user nova-compute[71285]:       <target type='serial' port='0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </console>
Apr 13 20:21:31 user nova-compute[71285]:     <input type='mouse' bus='ps2'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='input0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </input>
Apr 13 20:21:31 user nova-compute[71285]:     <input type='keyboard' bus='ps2'>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='input1'/>
Apr 13 20:21:31 user nova-compute[71285]:     </input>
Apr 13 20:21:31 user nova-compute[71285]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 20:21:31 user nova-compute[71285]:       <listen type='address' address='0.0.0.0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </graphics>
Apr 13 20:21:31 user nova-compute[71285]:     <audio id='1' type='none'/>
Apr 13 20:21:31 user nova-compute[71285]:     <video>
Apr 13 20:21:31 user nova-compute[71285]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='video0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </video>
Apr 13 20:21:31 user nova-compute[71285]:     <memballoon model='virtio'>
Apr 13 20:21:31 user nova-compute[71285]:       <stats period='10'/>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='balloon0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </memballoon>
Apr 13 20:21:31 user nova-compute[71285]:     <rng model='virtio'>
Apr 13 20:21:31 user nova-compute[71285]:       <backend model='random'>/dev/urandom</backend>
Apr 13 20:21:31 user nova-compute[71285]:       <alias name='rng0'/>
Apr 13 20:21:31 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 20:21:31 user nova-compute[71285]:     </rng>
Apr 13 20:21:31 user nova-compute[71285]:   </devices>
Apr 13 20:21:31 user nova-compute[71285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 20:21:31 user nova-compute[71285]:     <label>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</label>
Apr 13 20:21:31 user nova-compute[71285]:     <imagelabel>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</imagelabel>
Apr 13 20:21:31 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:31 user nova-compute[71285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 20:21:31 user nova-compute[71285]:     <label>+64055:+108</label>
Apr 13 20:21:31 user nova-compute[71285]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 20:21:31 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:31 user nova-compute[71285]: </domain>
Apr 13 20:21:31 user nova-compute[71285]:  {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 20:21:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully detached device tap210d0fac-67 from instance a78111f4-fcd5-4efc-977e-d8d32225c83f from the live domain config.
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG os_vif [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210d0fac-67, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:31 user nova-compute[71285]: INFO os_vif [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67')
Apr 13 20:21:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:31 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:31</nova:creationTime>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:31 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:31 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:31 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:31 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:31 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:31 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:31 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:31 user nova-compute[71285]:  {{(pid=71285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 20:21:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-unplugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-unplugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:32 user nova-compute[71285]: WARNING nova.compute.manager [req-bfa32f4c-a5a2-4c84-8be4-5c2dd4e13d1b req-02f951d2-e9e6-4ec1-a181-7a79ae0d6661 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-unplugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance with vm_state active and task_state None.
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-deleted-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:32 user nova-compute[71285]: INFO nova.compute.manager [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Neutron deleted interface 210d0fac-6751-4e8b-8d57-2ca9b09fdef9; detaching it from the instance and deleting it from the info cache
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.neutron [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquired lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.neutron [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.objects.instance [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Lazy-loading 'system_metadata' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.objects.instance [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Lazy-loading 'flavor' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 13 20:21:32 user nova-compute[71285]:   <name>instance-00000007</name>
Apr 13 20:21:32 user nova-compute[71285]:   <uuid>a78111f4-fcd5-4efc-977e-d8d32225c83f</uuid>
Apr 13 20:21:32 user nova-compute[71285]:   <metadata>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:32 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:31</nova:creationTime>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:32 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:32 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:32 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:32 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:32 user nova-compute[71285]:   </metadata>
Apr 13 20:21:32 user nova-compute[71285]:   <memory unit='KiB'>131072</memory>
Apr 13 20:21:32 user nova-compute[71285]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 20:21:32 user nova-compute[71285]:   <vcpu placement='static'>1</vcpu>
Apr 13 20:21:32 user nova-compute[71285]:   <resource>
Apr 13 20:21:32 user nova-compute[71285]:     <partition>/machine</partition>
Apr 13 20:21:32 user nova-compute[71285]:   </resource>
Apr 13 20:21:32 user nova-compute[71285]:   <sysinfo type='smbios'>
Apr 13 20:21:32 user nova-compute[71285]:     <system>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='version'>0.0.0</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='serial'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='uuid'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='family'>Virtual Machine</entry>
Apr 13 20:21:32 user nova-compute[71285]:     </system>
Apr 13 20:21:32 user nova-compute[71285]:   </sysinfo>
Apr 13 20:21:32 user nova-compute[71285]:   <os>
Apr 13 20:21:32 user nova-compute[71285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 20:21:32 user nova-compute[71285]:     <boot dev='hd'/>
Apr 13 20:21:32 user nova-compute[71285]:     <smbios mode='sysinfo'/>
Apr 13 20:21:32 user nova-compute[71285]:   </os>
Apr 13 20:21:32 user nova-compute[71285]:   <features>
Apr 13 20:21:32 user nova-compute[71285]:     <acpi/>
Apr 13 20:21:32 user nova-compute[71285]:     <apic/>
Apr 13 20:21:32 user nova-compute[71285]:     <vmcoreinfo state='on'/>
Apr 13 20:21:32 user nova-compute[71285]:   </features>
Apr 13 20:21:32 user nova-compute[71285]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 20:21:32 user nova-compute[71285]:     <model fallback='forbid'>Nehalem</model>
Apr 13 20:21:32 user nova-compute[71285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='vme'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='x2apic'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='hypervisor'/>
Apr 13 20:21:32 user nova-compute[71285]:   </cpu>
Apr 13 20:21:32 user nova-compute[71285]:   <clock offset='utc'>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='hpet' present='no'/>
Apr 13 20:21:32 user nova-compute[71285]:   </clock>
Apr 13 20:21:32 user nova-compute[71285]:   <on_poweroff>destroy</on_poweroff>
Apr 13 20:21:32 user nova-compute[71285]:   <on_reboot>restart</on_reboot>
Apr 13 20:21:32 user nova-compute[71285]:   <on_crash>destroy</on_crash>
Apr 13 20:21:32 user nova-compute[71285]:   <devices>
Apr 13 20:21:32 user nova-compute[71285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 20:21:32 user nova-compute[71285]:     <disk type='file' device='disk'>
Apr 13 20:21:32 user nova-compute[71285]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 20:21:32 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk' index='2'/>
Apr 13 20:21:32 user nova-compute[71285]:       <backingStore type='file' index='3'>
Apr 13 20:21:32 user nova-compute[71285]:         <format type='raw'/>
Apr 13 20:21:32 user nova-compute[71285]:         <source file='/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2'/>
Apr 13 20:21:32 user nova-compute[71285]:         <backingStore/>
Apr 13 20:21:32 user nova-compute[71285]:       </backingStore>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='vda' bus='virtio'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='virtio-disk0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </disk>
Apr 13 20:21:32 user nova-compute[71285]:     <disk type='file' device='cdrom'>
Apr 13 20:21:32 user nova-compute[71285]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 20:21:32 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config' index='1'/>
Apr 13 20:21:32 user nova-compute[71285]:       <backingStore/>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='hda' bus='ide'/>
Apr 13 20:21:32 user nova-compute[71285]:       <readonly/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='ide0-0-0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </disk>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='usb' index='0' model='none'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='usb'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='pci.0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='ide' index='0'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='ide'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <interface type='ethernet'>
Apr 13 20:21:32 user nova-compute[71285]:       <mac address='fa:16:3e:0c:9f:f0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='tap3ac07688-57'/>
Apr 13 20:21:32 user nova-compute[71285]:       <model type='virtio'/>
Apr 13 20:21:32 user nova-compute[71285]:       <mtu size='1442'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='net0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </interface>
Apr 13 20:21:32 user nova-compute[71285]:     <serial type='pty'>
Apr 13 20:21:32 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:32 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target type='isa-serial' port='0'>
Apr 13 20:21:32 user nova-compute[71285]:         <model name='isa-serial'/>
Apr 13 20:21:32 user nova-compute[71285]:       </target>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </serial>
Apr 13 20:21:32 user nova-compute[71285]:     <console type='pty' tty='/dev/pts/6'>
Apr 13 20:21:32 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:32 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target type='serial' port='0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </console>
Apr 13 20:21:32 user nova-compute[71285]:     <input type='mouse' bus='ps2'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='input0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </input>
Apr 13 20:21:32 user nova-compute[71285]:     <input type='keyboard' bus='ps2'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='input1'/>
Apr 13 20:21:32 user nova-compute[71285]:     </input>
Apr 13 20:21:32 user nova-compute[71285]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 20:21:32 user nova-compute[71285]:       <listen type='address' address='0.0.0.0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </graphics>
Apr 13 20:21:32 user nova-compute[71285]:     <audio id='1' type='none'/>
Apr 13 20:21:32 user nova-compute[71285]:     <video>
Apr 13 20:21:32 user nova-compute[71285]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='video0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </video>
Apr 13 20:21:32 user nova-compute[71285]:     <memballoon model='virtio'>
Apr 13 20:21:32 user nova-compute[71285]:       <stats period='10'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='balloon0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </memballoon>
Apr 13 20:21:32 user nova-compute[71285]:     <rng model='virtio'>
Apr 13 20:21:32 user nova-compute[71285]:       <backend model='random'>/dev/urandom</backend>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='rng0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </rng>
Apr 13 20:21:32 user nova-compute[71285]:   </devices>
Apr 13 20:21:32 user nova-compute[71285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 20:21:32 user nova-compute[71285]:     <label>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</label>
Apr 13 20:21:32 user nova-compute[71285]:     <imagelabel>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</imagelabel>
Apr 13 20:21:32 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:32 user nova-compute[71285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 20:21:32 user nova-compute[71285]:     <label>+64055:+108</label>
Apr 13 20:21:32 user nova-compute[71285]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 20:21:32 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:32 user nova-compute[71285]: </domain>
Apr 13 20:21:32 user nova-compute[71285]:  {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface> {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:58:4b:ca"/><model type="virtio"/><mtu size="1442"/><target dev="tap210d0fac-67"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 13 20:21:32 user nova-compute[71285]:   <name>instance-00000007</name>
Apr 13 20:21:32 user nova-compute[71285]:   <uuid>a78111f4-fcd5-4efc-977e-d8d32225c83f</uuid>
Apr 13 20:21:32 user nova-compute[71285]:   <metadata>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:32 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:31</nova:creationTime>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:32 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:32 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:32 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:32 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:32 user nova-compute[71285]:   </metadata>
Apr 13 20:21:32 user nova-compute[71285]:   <memory unit='KiB'>131072</memory>
Apr 13 20:21:32 user nova-compute[71285]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 13 20:21:32 user nova-compute[71285]:   <vcpu placement='static'>1</vcpu>
Apr 13 20:21:32 user nova-compute[71285]:   <resource>
Apr 13 20:21:32 user nova-compute[71285]:     <partition>/machine</partition>
Apr 13 20:21:32 user nova-compute[71285]:   </resource>
Apr 13 20:21:32 user nova-compute[71285]:   <sysinfo type='smbios'>
Apr 13 20:21:32 user nova-compute[71285]:     <system>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='product'>OpenStack Nova</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='version'>0.0.0</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='serial'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='uuid'>a78111f4-fcd5-4efc-977e-d8d32225c83f</entry>
Apr 13 20:21:32 user nova-compute[71285]:       <entry name='family'>Virtual Machine</entry>
Apr 13 20:21:32 user nova-compute[71285]:     </system>
Apr 13 20:21:32 user nova-compute[71285]:   </sysinfo>
Apr 13 20:21:32 user nova-compute[71285]:   <os>
Apr 13 20:21:32 user nova-compute[71285]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 13 20:21:32 user nova-compute[71285]:     <boot dev='hd'/>
Apr 13 20:21:32 user nova-compute[71285]:     <smbios mode='sysinfo'/>
Apr 13 20:21:32 user nova-compute[71285]:   </os>
Apr 13 20:21:32 user nova-compute[71285]:   <features>
Apr 13 20:21:32 user nova-compute[71285]:     <acpi/>
Apr 13 20:21:32 user nova-compute[71285]:     <apic/>
Apr 13 20:21:32 user nova-compute[71285]:     <vmcoreinfo state='on'/>
Apr 13 20:21:32 user nova-compute[71285]:   </features>
Apr 13 20:21:32 user nova-compute[71285]:   <cpu mode='custom' match='exact' check='full'>
Apr 13 20:21:32 user nova-compute[71285]:     <model fallback='forbid'>Nehalem</model>
Apr 13 20:21:32 user nova-compute[71285]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='vme'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='x2apic'/>
Apr 13 20:21:32 user nova-compute[71285]:     <feature policy='require' name='hypervisor'/>
Apr 13 20:21:32 user nova-compute[71285]:   </cpu>
Apr 13 20:21:32 user nova-compute[71285]:   <clock offset='utc'>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='pit' tickpolicy='delay'/>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 13 20:21:32 user nova-compute[71285]:     <timer name='hpet' present='no'/>
Apr 13 20:21:32 user nova-compute[71285]:   </clock>
Apr 13 20:21:32 user nova-compute[71285]:   <on_poweroff>destroy</on_poweroff>
Apr 13 20:21:32 user nova-compute[71285]:   <on_reboot>restart</on_reboot>
Apr 13 20:21:32 user nova-compute[71285]:   <on_crash>destroy</on_crash>
Apr 13 20:21:32 user nova-compute[71285]:   <devices>
Apr 13 20:21:32 user nova-compute[71285]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 13 20:21:32 user nova-compute[71285]:     <disk type='file' device='disk'>
Apr 13 20:21:32 user nova-compute[71285]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 13 20:21:32 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk' index='2'/>
Apr 13 20:21:32 user nova-compute[71285]:       <backingStore type='file' index='3'>
Apr 13 20:21:32 user nova-compute[71285]:         <format type='raw'/>
Apr 13 20:21:32 user nova-compute[71285]:         <source file='/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2'/>
Apr 13 20:21:32 user nova-compute[71285]:         <backingStore/>
Apr 13 20:21:32 user nova-compute[71285]:       </backingStore>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='vda' bus='virtio'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='virtio-disk0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </disk>
Apr 13 20:21:32 user nova-compute[71285]:     <disk type='file' device='cdrom'>
Apr 13 20:21:32 user nova-compute[71285]:       <driver name='qemu' type='raw' cache='none'/>
Apr 13 20:21:32 user nova-compute[71285]:       <source file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk.config' index='1'/>
Apr 13 20:21:32 user nova-compute[71285]:       <backingStore/>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='hda' bus='ide'/>
Apr 13 20:21:32 user nova-compute[71285]:       <readonly/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='ide0-0-0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </disk>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='usb' index='0' model='none'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='usb'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='pci' index='0' model='pci-root'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='pci.0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <controller type='ide' index='0'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='ide'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 13 20:21:32 user nova-compute[71285]:     </controller>
Apr 13 20:21:32 user nova-compute[71285]:     <interface type='ethernet'>
Apr 13 20:21:32 user nova-compute[71285]:       <mac address='fa:16:3e:0c:9f:f0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target dev='tap3ac07688-57'/>
Apr 13 20:21:32 user nova-compute[71285]:       <model type='virtio'/>
Apr 13 20:21:32 user nova-compute[71285]:       <mtu size='1442'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='net0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </interface>
Apr 13 20:21:32 user nova-compute[71285]:     <serial type='pty'>
Apr 13 20:21:32 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:32 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target type='isa-serial' port='0'>
Apr 13 20:21:32 user nova-compute[71285]:         <model name='isa-serial'/>
Apr 13 20:21:32 user nova-compute[71285]:       </target>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </serial>
Apr 13 20:21:32 user nova-compute[71285]:     <console type='pty' tty='/dev/pts/6'>
Apr 13 20:21:32 user nova-compute[71285]:       <source path='/dev/pts/6'/>
Apr 13 20:21:32 user nova-compute[71285]:       <log file='/opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/console.log' append='off'/>
Apr 13 20:21:32 user nova-compute[71285]:       <target type='serial' port='0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='serial0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </console>
Apr 13 20:21:32 user nova-compute[71285]:     <input type='mouse' bus='ps2'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='input0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </input>
Apr 13 20:21:32 user nova-compute[71285]:     <input type='keyboard' bus='ps2'>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='input1'/>
Apr 13 20:21:32 user nova-compute[71285]:     </input>
Apr 13 20:21:32 user nova-compute[71285]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Apr 13 20:21:32 user nova-compute[71285]:       <listen type='address' address='0.0.0.0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </graphics>
Apr 13 20:21:32 user nova-compute[71285]:     <audio id='1' type='none'/>
Apr 13 20:21:32 user nova-compute[71285]:     <video>
Apr 13 20:21:32 user nova-compute[71285]:       <model type='virtio' heads='1' primary='yes'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='video0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </video>
Apr 13 20:21:32 user nova-compute[71285]:     <memballoon model='virtio'>
Apr 13 20:21:32 user nova-compute[71285]:       <stats period='10'/>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='balloon0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </memballoon>
Apr 13 20:21:32 user nova-compute[71285]:     <rng model='virtio'>
Apr 13 20:21:32 user nova-compute[71285]:       <backend model='random'>/dev/urandom</backend>
Apr 13 20:21:32 user nova-compute[71285]:       <alias name='rng0'/>
Apr 13 20:21:32 user nova-compute[71285]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 13 20:21:32 user nova-compute[71285]:     </rng>
Apr 13 20:21:32 user nova-compute[71285]:   </devices>
Apr 13 20:21:32 user nova-compute[71285]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 13 20:21:32 user nova-compute[71285]:     <label>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</label>
Apr 13 20:21:32 user nova-compute[71285]:     <imagelabel>libvirt-a78111f4-fcd5-4efc-977e-d8d32225c83f</imagelabel>
Apr 13 20:21:32 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:32 user nova-compute[71285]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 13 20:21:32 user nova-compute[71285]:     <label>+64055:+108</label>
Apr 13 20:21:32 user nova-compute[71285]:     <imagelabel>+64055:+108</imagelabel>
Apr 13 20:21:32 user nova-compute[71285]:   </seclabel>
Apr 13 20:21:32 user nova-compute[71285]: </domain>
Apr 13 20:21:32 user nova-compute[71285]:  {{(pid=71285) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 13 20:21:32 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Detaching interface fa:16:3e:58:4b:ca failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap210d0fac-67' not found.
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Converting VIF {"id": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "address": "fa:16:3e:58:4b:ca", "network": {"id": "3aaf6092-79ef-43e4-b13b-5c5668d5a905", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1739102643", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.73", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap210d0fac-67", "ovs_interfaceid": "210d0fac-6751-4e8b-8d57-2ca9b09fdef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_vif [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap210d0fac-67, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:21:32 user nova-compute[71285]: INFO os_vif [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:4b:ca,bridge_name='br-int',has_traffic_filtering=True,id=210d0fac-6751-4e8b-8d57-2ca9b09fdef9,network=Network(3aaf6092-79ef-43e4-b13b-5c5668d5a905),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap210d0fac-67')
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [req-a98edafe-97f2-4583-9722-95c1d28173f7 req-76235c52-7b45-4ab4-9317-860460963cff service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:21:32 user nova-compute[71285]:   <nova:package version="0.0.0"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:name>tempest-device-tagging-server-524065510</nova:name>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:creationTime>2023-04-13 20:21:32</nova:creationTime>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:flavor name="m1.nano">
Apr 13 20:21:32 user nova-compute[71285]:     <nova:memory>128</nova:memory>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:disk>1</nova:disk>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:swap>0</nova:swap>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:vcpus>1</nova:vcpus>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:flavor>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:user uuid="4274e07dcb15438689444331f895ca18">tempest-TaggedAttachmentsTest-1082822260-project-member</nova:user>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:project uuid="10892937e6784f7bab0a6e5d835f9009">tempest-TaggedAttachmentsTest-1082822260</nova:project>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:owner>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:21:32 user nova-compute[71285]:   <nova:ports>
Apr 13 20:21:32 user nova-compute[71285]:     <nova:port uuid="3ac07688-57a6-45c2-9b2c-eea32bc1e446">
Apr 13 20:21:32 user nova-compute[71285]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:21:32 user nova-compute[71285]:     </nova:port>
Apr 13 20:21:32 user nova-compute[71285]:   </nova:ports>
Apr 13 20:21:32 user nova-compute[71285]: </nova:instance>
Apr 13 20:21:32 user nova-compute[71285]:  {{(pid=71285) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.utils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f1427-8462-41f8-8b9c-5fd68e4f0f92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[195340c0-13ee-4677-80bd-68f9069a943a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c6322-997d-4b62-b52c-bdadfe83ae04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de52b9c-7782-4c88-a647-0f4aa0c27946]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:21:32 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:21:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdfbeaf-d599-4c75-a34c-29ead3a39592]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG os_brick.utils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:32 user nova-compute[71285]: DEBUG nova.network.neutron [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [{"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:32 user nova-compute[71285]: INFO nova.compute.manager [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Swapping volume ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 for 62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Releasing lock "refresh_cache-a78111f4-fcd5-4efc-977e-d8d32225c83f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9cda1938-c0e2-4635-8e01-63f4b9dd48ca tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "interface-a78111f4-fcd5-4efc-977e-d8d32225c83f-210d0fac-6751-4e8b-8d57-2ca9b09fdef9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.719s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:34 user nova-compute[71285]: WARNING nova.compute.manager [req-d9842313-98a3-491c-ab02-4e9d14958536 req-679cd537-489b-4bb4-9dca-2fb54626f2db service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-210d0fac-6751-4e8b-8d57-2ca9b09fdef9 for instance with vm_state active and task_state None.
Apr 13 20:21:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': '62f36d4a-1896-4762-a8b9-7d13520c2554', 'serial': '62f36d4a-1896-4762-a8b9-7d13520c2554'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8'}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'serial'} {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:37 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:37 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:37 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[717501b5-119f-4d13-a05a-da30d79b28fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:21:37 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6323dd3-f41b-4fad-8394-55dea572d468]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554] added
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b67901-8cfa-4ed5-aa73-f710bc59c2e2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38307e38-6431-4253-81ed-aa0faf82e670]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awrEjMGp {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awrEjMGp" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef32b024-5370-42aa-9bd5-c2f4de60b96a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awrEjMGp'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c1ea6-a1da-4b82-b436-82901d6d9ad3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b624722-18d9-4be9-af14-90d0d7071366]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a85b22-6869-48de-b84a-df1dde854ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]
Apr 13 20:21:37 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c7d0d4-b4b0-4ad4-a94f-a0ee9870e609]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fe1f4-7686-4dae-afff-748dbcad8730]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:37 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[405a3f56-f048-468b-8c2b-99579884d5c8]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:21:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:21:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26366316531326332', 'path': '/dev/sdh'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366316531326332', 'path': '/dev/sdh'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:21:38 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lazy-loading 'flavor' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 483393536 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417286.4884887, c936eb14-b16e-46fb-9e39-5ba49da4fb73 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:21:41 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] VM Stopped (Lifecycle Event)
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e515b7d1-ceae-45de-a863-135533121975 None None] [instance: c936eb14-b16e-46fb-9e39-5ba49da4fb73] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 778043392 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 955252736 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRbuIAiW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'ed1aba59-6db5-47a3-bb7d-d1c2d80027b8': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:43 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b295b3-d35e-4323-b791-d410e51e406c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:43 user nova-compute[71285]: No targets found.
Apr 13 20:21:43 user nova-compute[71285]: iSNS:
Apr 13 20:21:43 user nova-compute[71285]: No targets found.
Apr 13 20:21:43 user nova-compute[71285]: STATIC:
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:43 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:43 user nova-compute[71285]: No targets found.
Apr 13 20:21:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:43 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:43 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[246302a1-89d0-4807-b200-c94bee671f58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb5514-449e-4f5e-b065-47360ba11f3e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:43 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6473d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8'): ({'sdi'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Removing single pathed devices sdi {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d28b797-b115-4e14-a079-d81baadbebab]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fddcf50-5bd7-4fdb-a284-b2d2d325a6b2]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Flushing IO for device /dev/sdi {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace9a703-ff57-4fea-a2b4-1f1195ce5adb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[157bae9e-0585-4dcf-bf27-cd92bef0ac79]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] SCSI volumes sdi have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9cd0f-1791-4dd2-acbc-00f3ae00d7cd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef85eeb5-75b8-41fe-a532-323ebcf251b6]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260]
Apr 13 20:21:43 user nova-compute[71285]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29486dd4-5ea6-4b68-8f4b-9454671655ac]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] <== disconnect_volume: return (392ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'da17669c-1ea2-450a-8183-40b47c4f41fc', 'attached_at': '', 'detached_at': '', 'volume_id': '62f36d4a-1896-4762-a8b9-7d13520c2554', 'serial'} {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: removing Cinder connection for volume ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 {{(pid=71285) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 13 20:21:43 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:21:43 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:21:43 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7703MB free_disk=26.600330352783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance da17669c-1ea2-450a-8183-40b47c4f41fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a78111f4-fcd5-4efc-977e-d8d32225c83f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] swap_volume: Updating volume ed1aba59-6db5-47a3-bb7d-d1c2d80027b8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "awrEjMGp", "auth_password": "Blw1MNYVGb9Oac", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "62f36d4a-1896-4762-a8b9-7d13520c2554"}, "status": "reserved", "instance": "da17669c-1ea2-450a-8183-40b47c4f41fc", "attached_at": "", "detached_at": "", "volume_id": "62f36d4a-1896-4762-a8b9-7d13520c2554", "serial": "62f36d4a-1896-4762-a8b9-7d13520c2554"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '62f36d4a-1896-4762-a8b9-7d13520c2554', 'no_device': None, 'attachment_id': '760cdb74-01ea-42b5-9bb1-c474ee65f8f8'} {{(pid=71285) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b88221fa-5b28-42f0-8b26-20b8ed74d5ed tempest-TestVolumeSwap-197204170 tempest-TestVolumeSwap-197204170-project-admin] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.085s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-changed-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing instance network info cache due to event network-changed-8a43e7e1-8da0-48b7-a18d-8899539118c7. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Acquiring lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Acquired lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Refreshing network info cache for port 8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG nova.network.neutron [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updated VIF entry in instance network info cache for port 8a43e7e1-8da0-48b7-a18d-8899539118c7. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG nova.network.neutron [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eca2042d-8982-4725-bc9d-852ac63b5e81 req-d095de00-37bd-45d3-ac64-c2416f1aa22e service nova] Releasing lock "refresh_cache-d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:21:45 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:46 user nova-compute[71285]: INFO nova.compute.manager [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Detaching volume 62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:46 user nova-compute[71285]: INFO nova.virt.block_device [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Attempting to driver detach volume 62f36d4a-1896-4762-a8b9-7d13520c2554 from mountpoint /dev/vdb
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Attempting to detach device vdb from instance da17669c-1ea2-450a-8183-40b47c4f41fc from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:46 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:46 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:46 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:46 user nova-compute[71285]:   <serial>62f36d4a-1896-4762-a8b9-7d13520c2554</serial>
Apr 13 20:21:46 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:21:46 user nova-compute[71285]: </disk>
Apr 13 20:21:46 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Successfully detached device vdb from instance da17669c-1ea2-450a-8183-40b47c4f41fc from the persistent domain config.
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da17669c-1ea2-450a-8183-40b47c4f41fc from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:21:46 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:21:46 user nova-compute[71285]:   <source dev="/dev/sdh"/>
Apr 13 20:21:46 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:21:46 user nova-compute[71285]:   <serial>62f36d4a-1896-4762-a8b9-7d13520c2554</serial>
Apr 13 20:21:46 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:21:46 user nova-compute[71285]: </disk>
Apr 13 20:21:46 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating instance_info_cache with network_info: [{"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-0136288f-abaf-4a7c-a878-db415ff98f4b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:46 user nova-compute[71285]: INFO nova.compute.manager [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Terminating instance
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417306.5373886, da17669c-1ea2-450a-8183-40b47c4f41fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:21:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Successfully detached device vdb from instance da17669c-1ea2-450a-8183-40b47c4f41fc from the live domain config.
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awrEjMGp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '62f36d4a-1896-4762-a8b9-7d13520c2554': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:46 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c982f6-d99b-4bb0-8d93-eb5a74ea69e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:46 user nova-compute[71285]: No targets found.
Apr 13 20:21:46 user nova-compute[71285]: iSNS:
Apr 13 20:21:46 user nova-compute[71285]: No targets found.
Apr 13 20:21:46 user nova-compute[71285]: STATIC:
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:46 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:46 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:46 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:46 user nova-compute[71285]: No targets found.
Apr 13 20:21:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:46 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:46 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cca17e-8d94-4c76-98e6-d5932768b05d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79903a-72ee-4b5a-b23b-a15c60fe6ba2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:46 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6473dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554'): ({'sdh'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Removing single pathed devices sdh {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3f3d9-f0ca-461c-b550-c6239ec35239]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7dd4052-4d8c-422c-a23c-bde658c795db]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Flushing IO for device /dev/sdh {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[06db7087-3a28-49a7-baae-04d88712d2fe]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd270cc0-b5f0-413e-a1ab-4127e9953766]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] SCSI volumes sdh have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be7b5a-7a65-4491-a076-b91763724c0e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee250d5-1055-4363-828d-d7404464fe2d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260]
Apr 13 20:21:46 user nova-compute[71285]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62f36d4a-1896-4762-a8b9-7d13520c2554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d662b7d3-e81c-4a62-b18e-5cdc2bfa8a46]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] <== disconnect_volume: return (350ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-299957f2-c005-4aba-ba4c-984d347f8efc req-c3dfaff6-79c3-42e1-92f8-fdf2a1915756 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e14ae9-afe7-4aba-90c2-2192f593c1b6 req-2b4359ce-05e0-4922-8ab4-7e473b447518 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-cd297158-7c28-4e96-9055-7547d626d066 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-b031fc7a-f7c8-4d0b-812f-b540682a2306 req-dfee2eab-8de7-458e-a76d-2176d1eed438 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-32e1b953-1235-44ba-918c-ff264b484629 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'flavor' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1555a217-49e4-45c1-b0e7-82e15eda664f tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.919s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Instance destroyed successfully.
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lazy-loading 'resources' on Instance uuid d3a56bab-d00c-4304-8c48-78bd9a9e5d4e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a43e7e1-8d, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ba:c6,bridge_name='br-int',has_traffic_filtering=True,id=8a43e7e1-8da0-48b7-a18d-8899539118c7,network=Network(a0f78602-1e31-4d8f-ac87-4a19cd056029),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a43e7e1-8d')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd297158-7c, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:0e:b6,bridge_name='br-int',has_traffic_filtering=True,id=cd297158-7c28-4e96-9055-7547d626d066,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcd297158-7c')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e89cf33-c2, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:0f:f5,bridge_name='br-int',has_traffic_filtering=True,id=4e89cf33-c25a-42d7-be8d-bfeeea25e607,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4e89cf33-c2')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32e1b953-12, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:36:ff,bridge_name='br-int',has_traffic_filtering=True,id=32e1b953-1235-44ba-918c-ff264b484629,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e1b953-12')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12991ac8-59, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:06:cc,bridge_name='br-int',has_traffic_filtering=True,id=12991ac8-5935-4b35-918a-015677766ea7,network=Network(0d05e3f4-7201-4c56-bf77-f842e674c5f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12991ac8-59')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "address": "fa:16:3e:3b:3e:e4", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1af834fc-09", "ovs_interfaceid": "1af834fc-094c-4fbc-a8fa-abf7d28cec5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1af834fc-09, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:3e:e4,bridge_name='br-int',has_traffic_filtering=True,id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1af834fc-09')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-194894390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-194894390',id=9,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbZ8n7vRxmsokOQkjwhA7Y4BF5Us23XtCWXaj8mHQJtuMKy1uSJmqf4BiyaNWoaVdYHk4IQ86DFNbSAgv/oHS9pE+IB/z9W+evnX9ulHV833/wZpt5E7/65isDEmtXiRg==',key_name='tempest-keypair-1712483657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e01e2122799d4cfe81a642146f5c1421',ramdisk_id='',reservation_id='r-2mzego45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1937190346',owner_user_name='tempest-TaggedBootDevicesTest_v242-1937190346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5a2f99d6d3ee4f1b968dcc6ed6fccb84',uuid=d3a56bab-d00c-4304-8c48-78bd9a9e5d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converting VIF {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6c3e557-a7, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:21:48 user nova-compute[71285]: INFO os_vif [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:67:b5,bridge_name='br-int',has_traffic_filtering=True,id=b6c3e557-a7be-4d2a-bd41-1e48291a36cb,network=Network(a5ebc511-c961-4ab1-8620-c595a9c8fbdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c3e557-a7')
Apr 13 20:21:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KflzqEtI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:48 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ec5864-df3a-4aea-95c4-aa2f03292e7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:48 user nova-compute[71285]: No targets found.
Apr 13 20:21:48 user nova-compute[71285]: iSNS:
Apr 13 20:21:48 user nova-compute[71285]: No targets found.
Apr 13 20:21:48 user nova-compute[71285]: STATIC:
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:48 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:48 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:48 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:48 user nova-compute[71285]: No targets found.
Apr 13 20:21:48 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:48 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:48 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f10b333-d515-4e3b-8207-d69dd2f8503c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471d344-b9a8-4893-81ab-11410b35de9b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:48 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:48 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:48 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70b8bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8dcc76-26b3-457b-8baf-b678ca0e4020]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ddf6e-0a49-45af-93ad-fbf9660e070a]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[98309154-9f7a-434b-b32e-7b485e58280d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b7b44-25e3-4b58-823d-5ea1012f7907]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ca69ba-f82c-446e-beb9-55ab663cbae0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-8a43e7e1-8da0-48b7-a18d-8899539118c7 for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-4e89cf33-c25a-42d7-be8d-bfeeea25e607 for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-1af834fc-094c-4fbc-a8fa-abf7d28cec5e for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-7fe3e307-c67a-415a-b4d3-04a462deb33f req-ad30d072-e2fe-4a59-9d98-4a3360354568 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-b6c3e557-a7be-4d2a-bd41-1e48291a36cb for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37041e6c-8bd0-4849-8ae2-fc26c6cde574]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260]
Apr 13 20:21:49 user nova-compute[71285]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-e36f7302-bead-431c-9726-87108119afb0 req-26384f7a-ad10-41e4-be76-56227f0f03df service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-cd297158-7c28-4e96-9055-7547d626d066 for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09705428-be59-4d47-8c48-3f7a0d94963a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f5f859-04e9-4cac-bd3f-08287bb68661]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== disconnect_volume: return (339ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPHqTwFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a683f0e-48ab-4e50-ac88-38a7d29c6f37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]: iSNS:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]: STATIC:
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:49 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:49 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea42b8a-f921-48d4-9d48-d283aee3425c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27827454-abd3-4694-b166-5a2085842ced]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6473d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c79ea5-14c4-4c60-b4cb-ba66a70a29bd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36767ec0-905d-4909-841c-9f5107c4b2dd]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[049ec193-4aae-412a-bd11-3f8a51be9573]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-32e1b953-1235-44ba-918c-ff264b484629 for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-unplugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-unplugged-12991ac8-5935-4b35-918a-015677766ea7 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Acquiring lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] No waiting events found dispatching network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING nova.compute.manager [req-01b95b3b-ecfa-4787-b2a8-7374462891d3 req-f582b105-8d2b-4772-a61f-d5a0b346b171 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received unexpected event network-vif-plugged-12991ac8-5935-4b35-918a-015677766ea7 for instance with vm_state active and task_state deleting.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb174884-2327-4545-8d47-ed316534dc86]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44868d-ccc4-4f25-bbd0-48701788b364]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2284fc49-db4f-431a-911b-60dcf99851c8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260]
Apr 13 20:21:49 user nova-compute[71285]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:400b6a69-9110-481d-89de-b9a4dad69bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e547328-6a0b-48c0-967e-dbc31badb284]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== disconnect_volume: return (319ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQjCvXBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:21:49 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[134f2f0a-eb49-4477-a4b0-8c8dfa0cc7ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]: iSNS:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]: STATIC:
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:21:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:21:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:21:49 user nova-compute[71285]: FIRMWARE:
Apr 13 20:21:49 user nova-compute[71285]: No targets found.
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:21:49 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:21:49 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f34532-3391-4a52-ba13-41bdf3678104]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d00efb-da69-4739-8eca-5fb7c78f4e4f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:21:49 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee02094-0726-4bea-b5e1-89e056c19d4c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d00ae8-5652-4900-b85a-d9f844d9befb]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[decf0345-9c63-48f0-ba60-fc313267fe41]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a0dbe9-ebd0-4be6-828f-6fd4200fcc44]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb852582-77fa-461b-bfee-f513284b2533]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e07642-fd92-433e-ba00-41cc070b8d08]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260]
Apr 13 20:21:49 user nova-compute[71285]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337, portal: 172.16.0.220,3260] successful.
Apr 13 20:21:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f494b4ba-5741-4d3f-8eb1-b5ff89f54337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efa50e-cacc-48e9-be25-aaeffa5e14d1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] <== disconnect_volume: return (312ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:21:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Deleting instance files /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e_del
Apr 13 20:21:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Deletion of /opt/stack/data/nova/instances/d3a56bab-d00c-4304-8c48-78bd9a9e5d4e_del complete
Apr 13 20:21:49 user nova-compute[71285]: INFO nova.compute.manager [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Took 3.31 seconds to destroy the instance on the hypervisor.
Apr 13 20:21:49 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:21:49 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:21:51 user nova-compute[71285]: DEBUG nova.compute.manager [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-deleted-1af834fc-094c-4fbc-a8fa-abf7d28cec5e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:51 user nova-compute[71285]: INFO nova.compute.manager [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Neutron deleted interface 1af834fc-094c-4fbc-a8fa-abf7d28cec5e; detaching it from the instance and deleting it from the info cache
Apr 13 20:21:51 user nova-compute[71285]: DEBUG nova.network.neutron [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [{"id": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "address": "fa:16:3e:0f:ba:c6", "network": {"id": "a0f78602-1e31-4d8f-ac87-4a19cd056029", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1003993155-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a43e7e1-8d", "ovs_interfaceid": "8a43e7e1-8da0-48b7-a18d-8899539118c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cd297158-7c28-4e96-9055-7547d626d066", "address": "fa:16:3e:aa:0e:b6", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd297158-7c", "ovs_interfaceid": "cd297158-7c28-4e96-9055-7547d626d066", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "address": "fa:16:3e:55:0f:f5", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e89cf33-c2", "ovs_interfaceid": "4e89cf33-c25a-42d7-be8d-bfeeea25e607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "32e1b953-1235-44ba-918c-ff264b484629", "address": "fa:16:3e:91:36:ff", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e1b953-12", "ovs_interfaceid": "32e1b953-1235-44ba-918c-ff264b484629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "12991ac8-5935-4b35-918a-015677766ea7", "address": "fa:16:3e:24:06:cc", "network": {"id": "0d05e3f4-7201-4c56-bf77-f842e674c5f4", "bridge": "br-int", "label": "tempest-device-tagging-net1-641517558", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12991ac8-59", "ovs_interfaceid": "12991ac8-5935-4b35-918a-015677766ea7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "address": "fa:16:3e:b0:67:b5", "network": {"id": "a5ebc511-c961-4ab1-8620-c595a9c8fbdb", "bridge": "br-int", "label": "tempest-device-tagging-net2-1159951654", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e01e2122799d4cfe81a642146f5c1421", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c3e557-a7", "ovs_interfaceid": "b6c3e557-a7be-4d2a-bd41-1e48291a36cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:51 user nova-compute[71285]: DEBUG nova.compute.manager [req-01999309-abda-4fd6-9da1-b9e3c78e4a05 req-347d693d-12c0-493c-8a83-9627da8ef538 service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Detach interface failed, port_id=1af834fc-094c-4fbc-a8fa-abf7d28cec5e, reason: Instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:21:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:52 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:21:53 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Took 3.18 seconds to deallocate network for instance.
Apr 13 20:21:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-deleted-12991ac8-5935-4b35-918a-015677766ea7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-deleted-32e1b953-1235-44ba-918c-ff264b484629 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-deleted-b6c3e557-a7be-4d2a-bd41-1e48291a36cb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f4d5f31e-7015-4b7a-bdea-2089f2ab5ee0 req-da35a556-b296-43c4-bb6d-011fe83477fe service nova] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Received event network-vif-deleted-8a43e7e1-8da0-48b7-a18d-8899539118c7 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:21:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:55 user nova-compute[71285]: INFO nova.compute.manager [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Took 2.32 seconds to detach 3 volumes for instance.
Apr 13 20:21:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:21:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:21:55 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:21:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:21:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:55 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Deleted allocations for instance d3a56bab-d00c-4304-8c48-78bd9a9e5d4e
Apr 13 20:21:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3adcd540-c484-4075-b839-dc2fc396a152 tempest-TaggedBootDevicesTest_v242-1937190346 tempest-TaggedBootDevicesTest_v242-1937190346-project-member] Lock "d3a56bab-d00c-4304-8c48-78bd9a9e5d4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.260s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:21:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:21:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:22:01 user nova-compute[71285]: INFO nova.compute.claims [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Claim successful on node user
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:22:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.policy [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:22:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Creating image(s)
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.171s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk 1073741824" returned: 0 in 0.055s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Successfully created port: b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Cannot resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'migration_context' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Ensure instance console log exists: /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:22:03 user nova-compute[71285]: INFO nova.compute.claims [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Claim successful on node user
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417308.4110792, d3a56bab-d00c-4304-8c48-78bd9a9e5d4e => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:03 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] VM Stopped (Lifecycle Event)
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d3cd4952-eac9-4e1f-8f67-30d5adaaceb3 None None] [instance: d3a56bab-d00c-4304-8c48-78bd9a9e5d4e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:22:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Successfully updated port: b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.policy [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cbfa14567af452db21cb0022514773b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41ed651e141447b995ccae680f1f3681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-changed-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Refreshing instance network info cache due to event network-changed-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:22:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Creating image(s)
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "/opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "/opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "/opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.304s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk 1073741824" returned: 0 in 0.106s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.415s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance network_info: |[{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Refreshing network info cache for port b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start _get_guest_xml network_info=[{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:22:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:22:04 user nova-compute[71285]:   <uuid>7d01394e-edb8-4c51-a71a-e07c0ee164db</uuid>
Apr 13 20:22:04 user nova-compute[71285]:   <name>instance-0000000c</name>
Apr 13 20:22:04 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:22:04 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:22:04 user nova-compute[71285]:   <metadata>
Apr 13 20:22:04 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:22:04 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeTestJSON-server-492449566</nova:name>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:22:04</nova:creationTime>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:22:04 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:22:04 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:owner>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:user uuid="b5210a73b1574e82838f3f0ccef93a25">tempest-AttachVolumeTestJSON-1545246928-project-member</nova:user>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:project uuid="587bca93ee3f45b9b5b1ceb91e972e7b">tempest-AttachVolumeTestJSON-1545246928</nova:project>
Apr 13 20:22:04 user nova-compute[71285]:       </nova:owner>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:22:04 user nova-compute[71285]:       <nova:ports>
Apr 13 20:22:04 user nova-compute[71285]:         <nova:port uuid="b5b9a9b4-bd38-4cfc-b483-9bae4721fb09">
Apr 13 20:22:04 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:22:04 user nova-compute[71285]:         </nova:port>
Apr 13 20:22:04 user nova-compute[71285]:       </nova:ports>
Apr 13 20:22:04 user nova-compute[71285]:     </nova:instance>
Apr 13 20:22:04 user nova-compute[71285]:   </metadata>
Apr 13 20:22:04 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:22:04 user nova-compute[71285]:     <system>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="serial">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="uuid">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:22:04 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:22:04 user nova-compute[71285]:     </system>
Apr 13 20:22:04 user nova-compute[71285]:   </sysinfo>
Apr 13 20:22:04 user nova-compute[71285]:   <os>
Apr 13 20:22:04 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:22:04 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:22:04 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:22:04 user nova-compute[71285]:   </os>
Apr 13 20:22:04 user nova-compute[71285]:   <features>
Apr 13 20:22:04 user nova-compute[71285]:     <acpi/>
Apr 13 20:22:04 user nova-compute[71285]:     <apic/>
Apr 13 20:22:04 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:22:04 user nova-compute[71285]:   </features>
Apr 13 20:22:04 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:22:04 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:22:04 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:22:04 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:22:04 user nova-compute[71285]:   </clock>
Apr 13 20:22:04 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:22:04 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:22:04 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:22:04 user nova-compute[71285]:   </cpu>
Apr 13 20:22:04 user nova-compute[71285]:   <devices>
Apr 13 20:22:04 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:22:04 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:22:04 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk"/>
Apr 13 20:22:04 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:22:04 user nova-compute[71285]:     </disk>
Apr 13 20:22:04 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:22:04 user nova-compute[71285]:       <mac address="fa:16:3e:b8:5a:71"/>
Apr 13 20:22:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:04 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:22:04 user nova-compute[71285]:       <target dev="tapb5b9a9b4-bd"/>
Apr 13 20:22:04 user nova-compute[71285]:     </interface>
Apr 13 20:22:04 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:22:04 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/console.log" append="off"/>
Apr 13 20:22:04 user nova-compute[71285]:     </serial>
Apr 13 20:22:04 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:22:04 user nova-compute[71285]:     <video>
Apr 13 20:22:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:04 user nova-compute[71285]:     </video>
Apr 13 20:22:04 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:22:04 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:22:04 user nova-compute[71285]:     </rng>
Apr 13 20:22:04 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:22:04 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:22:04 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:22:04 user nova-compute[71285]:     </memballoon>
Apr 13 20:22:04 user nova-compute[71285]:   </devices>
Apr 13 20:22:04 user nova-compute[71285]: </domain>
Apr 13 20:22:04 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG os_vif [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Successfully created port: 96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5b9a9b4-bd, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5b9a9b4-bd, col_values=(('external_ids', {'iface-id': 'b5b9a9b4-bd38-4cfc-b483-9bae4721fb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5a:71', 'vm-uuid': '7d01394e-edb8-4c51-a71a-e07c0ee164db'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:04 user nova-compute[71285]: INFO os_vif [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Cannot resize image /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'migration_context' on Instance uuid 66835d12-d155-4684-a9f0-41587936af9f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Ensure instance console log exists: /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No VIF found with MAC fa:16:3e:b8:5a:71, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updated VIF entry in instance network info cache for port b5b9a9b4-bd38-4cfc-b483-9bae4721fb09. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb0e44e2-fd66-4e0e-838e-5d5b9f901ba5 req-20959105-082c-4417-8f56-b6ce626e27b1 service nova] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Successfully updated port: 96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquired lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-changed-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Refreshing instance network info cache due to event network-changed-96c19e26-cbdc-46a9-9a5c-59ce6d04e416. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Acquiring lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Updating instance_info_cache with network_info: [{"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Releasing lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Instance network_info: |[{"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Acquired lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Refreshing network info cache for port 96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Start _get_guest_xml network_info=[{"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:22:05 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:05 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979321445',display_name='tempest-VolumesAdminNegativeTest-server-979321445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979321445',id=13,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-f72miee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:04Z,user_data=None,user_id='7cbfa14567af452db21cb0022514773b',uuid=66835d12-d155-4684-a9f0-41587936af9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'pci_devices' on Instance uuid 66835d12-d155-4684-a9f0-41587936af9f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:22:05 user nova-compute[71285]:   <uuid>66835d12-d155-4684-a9f0-41587936af9f</uuid>
Apr 13 20:22:05 user nova-compute[71285]:   <name>instance-0000000d</name>
Apr 13 20:22:05 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:22:05 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:22:05 user nova-compute[71285]:   <metadata>
Apr 13 20:22:05 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:22:05 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:name>tempest-VolumesAdminNegativeTest-server-979321445</nova:name>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:22:05</nova:creationTime>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:22:05 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:22:05 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:owner>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:user uuid="7cbfa14567af452db21cb0022514773b">tempest-VolumesAdminNegativeTest-1573778134-project-member</nova:user>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:project uuid="41ed651e141447b995ccae680f1f3681">tempest-VolumesAdminNegativeTest-1573778134</nova:project>
Apr 13 20:22:05 user nova-compute[71285]:       </nova:owner>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:22:05 user nova-compute[71285]:       <nova:ports>
Apr 13 20:22:05 user nova-compute[71285]:         <nova:port uuid="96c19e26-cbdc-46a9-9a5c-59ce6d04e416">
Apr 13 20:22:05 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:22:05 user nova-compute[71285]:         </nova:port>
Apr 13 20:22:05 user nova-compute[71285]:       </nova:ports>
Apr 13 20:22:05 user nova-compute[71285]:     </nova:instance>
Apr 13 20:22:05 user nova-compute[71285]:   </metadata>
Apr 13 20:22:05 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:22:05 user nova-compute[71285]:     <system>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="serial">66835d12-d155-4684-a9f0-41587936af9f</entry>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="uuid">66835d12-d155-4684-a9f0-41587936af9f</entry>
Apr 13 20:22:05 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:22:05 user nova-compute[71285]:     </system>
Apr 13 20:22:05 user nova-compute[71285]:   </sysinfo>
Apr 13 20:22:05 user nova-compute[71285]:   <os>
Apr 13 20:22:05 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:22:05 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:22:05 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:22:05 user nova-compute[71285]:   </os>
Apr 13 20:22:05 user nova-compute[71285]:   <features>
Apr 13 20:22:05 user nova-compute[71285]:     <acpi/>
Apr 13 20:22:05 user nova-compute[71285]:     <apic/>
Apr 13 20:22:05 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:22:05 user nova-compute[71285]:   </features>
Apr 13 20:22:05 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:22:05 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:22:05 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:22:05 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:22:05 user nova-compute[71285]:   </clock>
Apr 13 20:22:05 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:22:05 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:22:05 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:22:05 user nova-compute[71285]:   </cpu>
Apr 13 20:22:05 user nova-compute[71285]:   <devices>
Apr 13 20:22:05 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:22:05 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:22:05 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk"/>
Apr 13 20:22:05 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:22:05 user nova-compute[71285]:     </disk>
Apr 13 20:22:05 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:22:05 user nova-compute[71285]:       <mac address="fa:16:3e:ea:f5:ac"/>
Apr 13 20:22:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:05 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:22:05 user nova-compute[71285]:       <target dev="tap96c19e26-cb"/>
Apr 13 20:22:05 user nova-compute[71285]:     </interface>
Apr 13 20:22:05 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:22:05 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/console.log" append="off"/>
Apr 13 20:22:05 user nova-compute[71285]:     </serial>
Apr 13 20:22:05 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:22:05 user nova-compute[71285]:     <video>
Apr 13 20:22:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:05 user nova-compute[71285]:     </video>
Apr 13 20:22:05 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:22:05 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:22:05 user nova-compute[71285]:     </rng>
Apr 13 20:22:05 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:22:05 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:22:05 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:22:05 user nova-compute[71285]:     </memballoon>
Apr 13 20:22:05 user nova-compute[71285]:   </devices>
Apr 13 20:22:05 user nova-compute[71285]: </domain>
Apr 13 20:22:05 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979321445',display_name='tempest-VolumesAdminNegativeTest-server-979321445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979321445',id=13,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-f72miee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:04Z,user_data=None,user_id='7cbfa14567af452db21cb0022514773b',uuid=66835d12-d155-4684-a9f0-41587936af9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG os_vif [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96c19e26-cb, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96c19e26-cb, col_values=(('external_ids', {'iface-id': '96c19e26-cbdc-46a9-9a5c-59ce6d04e416', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:f5:ac', 'vm-uuid': '66835d12-d155-4684-a9f0-41587936af9f'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:05 user nova-compute[71285]: INFO os_vif [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb')
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] No VIF found with MAC fa:16:3e:ea:f5:ac, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Updated VIF entry in instance network info cache for port 96c19e26-cbdc-46a9-9a5c-59ce6d04e416. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Updating instance_info_cache with network_info: [{"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-198f872f-8a5b-4e4b-8403-4009604f16fa req-c3d87c6f-2a1a-4087-9039-fc1dc1d7c882 service nova] Releasing lock "refresh_cache-66835d12-d155-4684-a9f0-41587936af9f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:06 user nova-compute[71285]: WARNING nova.compute.manager [req-9d421e9f-1465-4af8-9072-f657755b3fd6 req-3197f19a-4173-4d81-a97b-7ce1610bada0 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state building and task_state spawning.
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] No waiting events found dispatching network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:07 user nova-compute[71285]: WARNING nova.compute.manager [req-8c0d8e46-08a6-4d04-960f-34bd583b44ee req-14b17e29-2237-4b8a-ae75-32935b5b248b service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received unexpected event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance with vm_state building and task_state spawning.
Apr 13 20:22:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:08 user nova-compute[71285]: WARNING nova.compute.manager [req-47e9cad8-2c1b-4ad8-a911-3c08e8c1f148 req-a799bd26-d73d-46ed-99bf-388bc38a6227 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state building and task_state spawning.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417329.3924236, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Resumed (Lifecycle Event)
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance spawned successfully.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417329.3962755, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Started (Lifecycle Event)
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Took 7.11 seconds to spawn the instance on the hypervisor.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Took 7.77 seconds to build instance.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-695a1381-bca5-4875-825b-501abdac7b2d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.862s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417329.8412666, 66835d12-d155-4684-a9f0-41587936af9f => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] VM Resumed (Lifecycle Event)
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Instance spawned successfully.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417329.842548, 66835d12-d155-4684-a9f0-41587936af9f => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] VM Started (Lifecycle Event)
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] No waiting events found dispatching network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:09 user nova-compute[71285]: WARNING nova.compute.manager [req-454dce5a-05bd-4a3d-85b1-886d49a991fb req-5a59f94b-c274-467f-a8e2-ead842f83028 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received unexpected event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance with vm_state building and task_state spawning.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:22:09 user nova-compute[71285]: INFO nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Took 6.12 seconds to spawn the instance on the hypervisor.
Apr 13 20:22:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:10 user nova-compute[71285]: INFO nova.compute.manager [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Took 6.81 seconds to build instance.
Apr 13 20:22:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5d449d5-5fa9-4121-ab17-a247fa98bdd1 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.911s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:22 user nova-compute[71285]: INFO nova.compute.manager [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Terminating instance
Apr 13 20:22:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-unplugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-unplugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-3658ea45-ae6f-4c61-91b8-ff8d665aa7dc req-942bb38f-5da8-4836-854f-ab1857a2fed5 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-unplugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Instance destroyed successfully.
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lazy-loading 'resources' on Instance uuid a78111f4-fcd5-4efc-977e-d8d32225c83f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-524065510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-524065510',id=7,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTX5KJjxGnDYv/L1aIfIAd4H+L5NboIp2dRNr7BNw9W8XndrgdFlBtWq/KCKpJU53EmKSP373WiTk0WcT4sGqSJFPuzADjIx8Z+q/5adkq2utgpgGGDE6hFXHr+lGuxpg==',key_name='tempest-keypair-407107657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10892937e6784f7bab0a6e5d835f9009',ramdisk_id='',reservation_id='r-wrn4d8vd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1082822260',owner_user_name='tempest-TaggedAttachmentsTest-1082822260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4274e07dcb15438689444331f895ca18',uuid=a78111f4-fcd5-4efc-977e-d8d32225c83f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converting VIF {"id": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "address": "fa:16:3e:0c:9f:f0", "network": {"id": "cace8c06-4171-49b3-bc24-faaa03dc8a09", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-530901248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10892937e6784f7bab0a6e5d835f9009", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ac07688-57", "ovs_interfaceid": "3ac07688-57a6-45c2-9b2c-eea32bc1e446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG os_vif [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ac07688-57, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:23 user nova-compute[71285]: INFO os_vif [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:9f:f0,bridge_name='br-int',has_traffic_filtering=True,id=3ac07688-57a6-45c2-9b2c-eea32bc1e446,network=Network(cace8c06-4171-49b3-bc24-faaa03dc8a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ac07688-57')
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Deleting instance files /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f_del
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Deletion of /opt/stack/data/nova/instances/a78111f4-fcd5-4efc-977e-d8d32225c83f_del complete
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.compute.manager [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 13 20:22:23 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Took 0.74 seconds to deallocate network for instance.
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-deleted-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:23 user nova-compute[71285]: INFO nova.compute.manager [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Neutron deleted interface 3ac07688-57a6-45c2-9b2c-eea32bc1e446; detaching it from the instance and deleting it from the info cache
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-91409f51-d30f-4a9a-ba09-8ec542b0b085 req-50b1cec3-3791-4502-b04e-0bf1be7831b6 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Detach interface failed, port_id=3ac07688-57a6-45c2-9b2c-eea32bc1e446, reason: Instance a78111f4-fcd5-4efc-977e-d8d32225c83f could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:24 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Deleted allocations for instance a78111f4-fcd5-4efc-977e-d8d32225c83f
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a0491c03-8121-4166-983e-19e50278c9a7 tempest-TaggedAttachmentsTest-1082822260 tempest-TaggedAttachmentsTest-1082822260-project-member] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.166s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Acquiring lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] Lock "a78111f4-fcd5-4efc-977e-d8d32225c83f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] No waiting events found dispatching network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:24 user nova-compute[71285]: WARNING nova.compute.manager [req-5b6ff154-084b-47bd-afe4-d0a58cfd36d0 req-148154ed-c642-4b1b-a0ae-e3e69a421b32 service nova] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Received unexpected event network-vif-plugged-3ac07688-57a6-45c2-9b2c-eea32bc1e446 for instance with vm_state deleted and task_state None.
Apr 13 20:22:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:27 user nova-compute[71285]: INFO nova.compute.manager [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Terminating instance
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-unplugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] No waiting events found dispatching network-vif-unplugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-8731602f-015e-4241-9a04-9f7accd05e79 req-5eb00265-c060-4a6c-b90e-3f2e2c6e657f service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-unplugged-afb15346-ee62-4c52-9603-035c27a22167 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Instance destroyed successfully.
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lazy-loading 'resources' on Instance uuid 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-757898920',display_name='tempest-VolumesNegativeTest-instance-757898920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-757898920',id=10,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b0fe0b98cb1466db76778e75e76bbc8',ramdisk_id='',reservation_id='r-zppqrutu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1033466652',owner_user_name='tempest-VolumesNegativeTest-1033466652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:45Z,user_data=None,user_id='be2777ed1017497ba7d96ca9d28e4d0c',uuid=4586f280-bf80-4ec1-b5bd-b51c11dc4d38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converting VIF {"id": "afb15346-ee62-4c52-9603-035c27a22167", "address": "fa:16:3e:3f:4f:29", "network": {"id": "678fa805-6dae-4db2-ba04-6b0e8bf5e9d0", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "119ae20419f24e47b2ffb6688bf6c4b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafb15346-ee", "ovs_interfaceid": "afb15346-ee62-4c52-9603-035c27a22167", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG os_vif [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafb15346-ee, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:27 user nova-compute[71285]: INFO os_vif [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:4f:29,bridge_name='br-int',has_traffic_filtering=True,id=afb15346-ee62-4c52-9603-035c27a22167,network=Network(678fa805-6dae-4db2-ba04-6b0e8bf5e9d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafb15346-ee')
Apr 13 20:22:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Deleting instance files /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38_del
Apr 13 20:22:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Deletion of /opt/stack/data/nova/instances/4586f280-bf80-4ec1-b5bd-b51c11dc4d38_del complete
Apr 13 20:22:27 user nova-compute[71285]: INFO nova.compute.manager [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 13 20:22:27 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:22:27 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:28 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Took 0.45 seconds to deallocate network for instance.
Apr 13 20:22:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-d67249cb-280c-4006-82b1-f62c17538ad3 req-03e540cb-0436-4ef8-9f31-a2444d37c5b0 service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-deleted-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:28 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Deleted allocations for instance 4586f280-bf80-4ec1-b5bd-b51c11dc4d38
Apr 13 20:22:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6a0a7c8c-faf3-4ad1-854f-3c55c61ad463 tempest-VolumesNegativeTest-1033466652 tempest-VolumesNegativeTest-1033466652-project-member] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.596s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Acquiring lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] Lock "4586f280-bf80-4ec1-b5bd-b51c11dc4d38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] No waiting events found dispatching network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:29 user nova-compute[71285]: WARNING nova.compute.manager [req-8f929ea0-333e-47b6-b607-33e74bb590d5 req-72ec1901-852d-45cf-8c6e-6069a99f474c service nova] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Received unexpected event network-vif-plugged-afb15346-ee62-4c52-9603-035c27a22167 for instance with vm_state deleted and task_state None.
Apr 13 20:22:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-changed-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing instance network info cache due to event network-changed-b2c1c646-b65c-4543-bf25-b89ff954fdd1. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:22:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Acquiring lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Acquired lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:33 user nova-compute[71285]: DEBUG nova.network.neutron [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Refreshing network info cache for port b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updated VIF entry in instance network info cache for port b2c1c646-b65c-4543-bf25-b89ff954fdd1. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8f136bbd-3c6e-4f52-aaa9-343af86a01c5 req-333b8310-9bea-4440-b8f2-4ecf46e03a35 service nova] Releasing lock "refresh_cache-8587fcac-cc5b-4fe7-92f9-8bf675a9a872" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing instance network info cache due to event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Acquiring lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Acquired lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:35 user nova-compute[71285]: INFO nova.compute.manager [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Attaching volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 to /dev/vdb
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.utils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[048b7f8c-5adb-4e2e-b256-cde298f7d730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45aebd8-de63-476c-a2fb-a89e349b74eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd14770-de77-439c-a290-74c16aaeff1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c7b67e-a23f-45d1-a442-7008b1f465ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG nova.network.neutron [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updated VIF entry in instance network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG nova.network.neutron [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-daf99ea7-5402-44c9-a15c-c4926ec22411 req-2d82f77c-bb32-4197-93be-58825cdfb96f service nova] Releasing lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:35 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b9a0d2-4cdd-48d3-87e5-76fcf0728cc9]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG os_brick.utils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating existing volume attachment record: 0ee659f7-0124-40da-990f-0d2c221e3c4d {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:35 user nova-compute[71285]: INFO nova.compute.manager [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Terminating instance
Apr 13 20:22:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-c47611ad-13ce-4ac6-9f54-fbf522f504b8 req-a908201e-3935-4026-8049-dc521d82763a service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-0f95227c-343f-467b-8359-aaae53160811 req-5ff1e7b2-653d-4387-8169-dbf1b1f04fdf service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-0fc22c68-14c3-4803-952d-32dac032db89 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: INFO nova.compute.manager [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Terminating instance
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:36 user nova-compute[71285]: WARNING nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b2c1c646-b65c-4543-bf25-b89ff954fdd1 for instance with vm_state active and task_state deleting.
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-a7dc7580-72fd-4f86-8a64-0146beb85fac req-a15ab1ed-b72f-4ff2-9fa3-a85578d67269 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Instance destroyed successfully.
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lazy-loading 'resources' on Instance uuid 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Instance destroyed successfully.
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lazy-loading 'resources' on Instance uuid da17669c-1ea2-450a-8183-40b47c4f41fc {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2c1c646-b6, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1482198801',display_name='tempest-TestVolumeSwap-server-1482198801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1482198801',id=5,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrwrPfleyNjl3pDB5OkN2SYvDCZ013r8+oGp8DrB4SN27ompGWdOkKmSpJhoB5cQCLOWrXxLcw6gtj75RcWJZ4DWqDRz9J0aW7xIy1OvV2R0hIUpHmgCErOlVkccauWWg==',key_name='tempest-keypair-1666630945',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49944b378c2b4e618a631771465a4a9b',ramdisk_id='',reservation_id='r-sdldkxbk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1264222431',owner_user_name='tempest-TestVolumeSwap-1264222431-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='195c6c0bc1ec4796b5c1e2ba88c7534a',uuid=da17669c-1ea2-450a-8183-40b47c4f41fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converting VIF {"id": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "address": "fa:16:3e:e4:c4:8f", "network": {"id": "3036b30e-22ce-48cd-a4f0-1e9b60c0af5a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2103649509-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49944b378c2b4e618a631771465a4a9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e161dc0-b1", "ovs_interfaceid": "3e161dc0-b110-47f1-9a0a-f9add33a394b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e161dc0-b1, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:28:28,bridge_name='br-int',has_traffic_filtering=True,id=b2c1c646-b65c-4543-bf25-b89ff954fdd1,network=Network(17186205-53ed-4e04-8d16-ac48ae498058),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2c1c646-b6')
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58a1b4af-74, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: INFO os_vif [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:c4:8f,bridge_name='br-int',has_traffic_filtering=True,id=3e161dc0-b110-47f1-9a0a-f9add33a394b,network=Network(3036b30e-22ce-48cd-a4f0-1e9b60c0af5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e161dc0-b1')
Apr 13 20:22:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Deleting instance files /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc_del
Apr 13 20:22:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Deletion of /opt/stack/data/nova/instances/da17669c-1ea2-450a-8183-40b47c4f41fc_del complete
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:78:b7,bridge_name='br-int',has_traffic_filtering=True,id=58a1b4af-7470-4cef-8c7a-7e611f8942fb,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap58a1b4af-74')
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51a691d6-af, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:37 user nova-compute[71285]: INFO nova.compute.manager [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Took 1.40 seconds to destroy the instance on the hypervisor.
Apr 13 20:22:37 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:86:66,bridge_name='br-int',has_traffic_filtering=True,id=51a691d6-af80-4126-9fa3-99fd3ee39a9d,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap51a691d6-af')
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fc22c68-14, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:1e:06,bridge_name='br-int',has_traffic_filtering=True,id=0fc22c68-14c3-4803-952d-32dac032db89,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fc22c68-14')
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee2ced5f-37, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:0c:0e,bridge_name='br-int',has_traffic_filtering=True,id=ee2ced5f-3757-4527-a93f-72d920a58291,network=Network(a081e803-ef34-4744-8355-532db29d9e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee2ced5f-37')
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3deaefd-62, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:e0:68,bridge_name='br-int',has_traffic_filtering=True,id=b3deaefd-62cd-4147-b744-783c9f5ff678,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3deaefd-62')
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-13T20:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1152408138',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1152408138',id=8,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrWndB892+fnXcT9OTa5J6yUSkNB3QrEgVu8kCtWk1JC5+5xJL7ZB4/XFYvRzCvotXBIa1BCMrxq5pvDS+4bV0VFydq/6gIyKjAP1QTXINRYnPlvE2yfHybEc/Xw/avw==',key_name='tempest-keypair-187606045',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ced32cd96594324b6b8792ef56e28c5',ramdisk_id='',reservation_id='r-8h3hj87t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-619300676',owner_user_name='tempest-TaggedBootDevicesTest-619300676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dc7db2b4cb64d2e9ad08692b248bb18',uuid=8587fcac-cc5b-4fe7-92f9-8bf675a9a872,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converting VIF {"id": "68c624f1-a380-4397-b311-6104fad344a8", "address": "fa:16:3e:b4:53:2b", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68c624f1-a3", "ovs_interfaceid": "68c624f1-a380-4397-b311-6104fad344a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68c624f1-a3, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:38 user nova-compute[71285]: INFO os_vif [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:53:2b,bridge_name='br-int',has_traffic_filtering=True,id=68c624f1-a380-4397-b311-6104fad344a8,network=Network(8e5e046b-8f60-4247-9c4e-cec1d1352bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68c624f1-a3')
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pvQLZJFT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417343.0893195, a78111f4-fcd5-4efc-977e-d8d32225c83f => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:38 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] VM Stopped (Lifecycle Event)
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf10e2ae-082c-405b-81aa-ab422bab4ea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: iSNS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: STATIC:
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: FIRMWARE:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:22:38 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71ec3ba3-710f-4e70-9cda-fc88c8c7ab80 None None] [instance: a78111f4-fcd5-4efc-977e-d8d32225c83f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6981a-b5b3-4809-85a7-e4733b1bd216]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a916b-cf54-4af8-8eaa-c1d994cf3448]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a38a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c'): ({'sdg'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Removing single pathed devices sdg {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33cca8-bdde-456d-8449-65dfb633d6a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d187b449-7240-47d2-af75-c1ff1d206fcf]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flushing IO for device /dev/sdg {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4169c2b3-45f9-4942-b4a9-6b9c76a48b59]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bb75f-1bd5-47fc-a915-44ccdc589a9e]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] SCSI volumes sdg have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edba46d-bb53-463a-b4aa-db5a82eb52dc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-51a691d6-af80-4126-9fa3-99fd3ee39a9d for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-ee2ced5f-3757-4527-a93f-72d920a58291 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-ee2ced5f-3757-4527-a93f-72d920a58291 for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-68c624f1-a380-4397-b311-6104fad344a8 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-68c624f1-a380-4397-b311-6104fad344a8 for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-unplugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] No waiting events found dispatching network-vif-unplugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ba7bc48-a8de-4d50-b5b5-8c87df5b10ff req-0dfb161a-b955-48cd-bd83-5352766301d2 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-unplugged-3e161dc0-b110-47f1-9a0a-f9add33a394b for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9053c-d34b-4a0b-b180-672d9b72a44b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260]
Apr 13 20:22:38 user nova-compute[71285]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88153816-fae2-4266-8f74-c06985cbe41c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ca0a47-c3c3-40ea-b2a0-46a0b2584ae3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== disconnect_volume: return (344ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-1c15d61b-ca2b-4406-ad8c-2684d94092b7 req-28f6163b-c806-475a-9e20-b1af9c58f9f1 service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-0fc22c68-14c3-4803-952d-32dac032db89 for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BTzHeGiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ef7f8-59bb-4c25-a923-4051aa3ed41f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: iSNS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: STATIC:
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: FIRMWARE:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:22:38 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bf4c8b-e20d-4dc5-b778-59aea2a0b01b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0692798-790f-4f19-ab11-b26a62be398f]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c (non-flash)
Apr 13 20:22:38 user nova-compute[71285]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645872e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c'): ({'sde'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Removing single pathed devices sde {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9360b78e-8621-4c21-b5d9-94442fe79f5e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88db2d5-84a5-492b-adcb-4fa859aa9699]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flushing IO for device /dev/sde {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc329a7-7d15-4112-a5b3-f869df96dd91]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c8594c-df01-441e-87ed-c6b37d749831]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebf854a-7707-4293-bda8-ffa21d6e774e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a9c983-60e1-4e1d-a725-cca1db9f6597]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260]
Apr 13 20:22:38 user nova-compute[71285]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2979586-cf14-4797-b906-547f3363090c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe7fc63-dd60-476a-8c17-88bf57e05ea7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== disconnect_volume: return (327ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TmlDkvwX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d2b378-84dd-4888-9ceb-ef9d2389126f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: iSNS:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]: STATIC:
Apr 13 20:22:38 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05
Apr 13 20:22:38 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:38 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:38 user nova-compute[71285]: FIRMWARE:
Apr 13 20:22:38 user nova-compute[71285]: No targets found.
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:22:38 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:22:38 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb3dc56-7764-4d74-990d-2e0c7071756c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc5d30-d51c-4c15-a5d2-d11ac7b54f31]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 (non-flash)
Apr 13 20:22:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc658acdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05'): ({'sdf'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Removing single pathed devices sdf {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f102f35-4e7a-48de-bc60-ebd18b128f65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f2c208-79cb-4380-af27-6763ffd854b0]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Flushing IO for device /dev/sdf {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36054a0e-37d7-4e20-b34e-989fc583401f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-58a1b4af-7470-4cef-8c7a-7e611f8942fb for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-unplugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-unplugged-b3deaefd-62cd-4147-b744-783c9f5ff678 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Acquiring lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] No waiting events found dispatching network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:38 user nova-compute[71285]: WARNING nova.compute.manager [req-e21bb4f8-fd3d-43b9-83af-4f702c9e62c3 req-cf6c5454-356f-45bc-be13-d6dd71b38e0f service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received unexpected event network-vif-plugged-b3deaefd-62cd-4147-b744-783c9f5ff678 for instance with vm_state active and task_state deleting.
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510cf10-0855-4714-9f7f-3ff16afc8803]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:38 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df9396-15f8-4d2b-a1ab-a823d7af513d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Took 1.10 seconds to deallocate network for instance.
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'flavor' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99137e5-6932-487e-85fd-3c8a1ab71086]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260]
Apr 13 20:22:39 user nova-compute[71285]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:39 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce955f5a-7ac3-40f7-ac14-f9c88130ab05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[52160a9d-49b6-40c8-9b24-0083d14d4151]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] <== disconnect_volume: return (328ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Deleting instance files /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872_del
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Deletion of /opt/stack/data/nova/instances/8587fcac-cc5b-4fe7-92f9-8bf675a9a872_del complete
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.compute.manager [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Took 3.47 seconds to destroy the instance on the hypervisor.
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.compute.manager [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attaching volume 73e8450f-52ed-4e90-83e8-1ba72b5e60cb to /dev/vdb
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.utils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4214178f-e700-4ae3-9a2c-55b1f4c47140]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f1015-4644-4a86-a313-7779879ddad0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de33490-4378-4bd4-b9bd-db857a125ddf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f24748-2a5e-4ca3-95bb-118d4f7c2526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Deleted allocations for instance da17669c-1ea2-450a-8183-40b47c4f41fc
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:39 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe08a1e-4171-4ab9-841c-0cea09824cac]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG os_brick.utils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating existing volume attachment record: 15fe5c85-041d-458e-96f0-ec9093181697 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:22:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8487db15-41fd-48c7-8c66-d48f90bcfdfb tempest-TestVolumeSwap-1264222431 tempest-TestVolumeSwap-1264222431-project-member] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Acquiring lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] Lock "da17669c-1ea2-450a-8183-40b47c4f41fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] No waiting events found dispatching network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:40 user nova-compute[71285]: WARNING nova.compute.manager [req-1680875b-174e-4397-87da-244b39e46658 req-61d7808d-601b-4f3e-a793-1cd0844d84e7 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received unexpected event network-vif-plugged-3e161dc0-b110-47f1-9a0a-f9add33a394b for instance with vm_state deleted and task_state None.
Apr 13 20:22:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-9ebf6e16-00dc-43b6-8f0c-bf82a8b412db req-26207d45-e229-4eb6-8352-9099e0f8edf8 service nova] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Received event network-vif-deleted-3e161dc0-b110-47f1-9a0a-f9add33a394b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIyprYEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:41 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:41 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:41 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740f071-31c7-4983-bb38-24eb9453aae2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:22:41 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f98525c-1ce4-4092-a3c9-5c7a941125ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748] added
Apr 13 20:22:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fa36fd-ccf5-48d8-9e5b-ad1f9505b510]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93808b30-bf12-4e10-908c-3d5890b11c8c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIyprYEP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIyprYEP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be6e7cc-d17b-4865-a2e3-948c65e938c2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bIyprYEP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[addb16b0-dc62-491f-8c3b-b3de732b8f9d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b4208-df1e-4129-b86d-9687a8043744]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:22:41 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:22:41 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:41 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:22:41 user nova-compute[71285]: 
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade724a-b92a-471b-ae25-449038ebffb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260]
Apr 13 20:22:41 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167fb1f-eea2-48eb-8380-9545af32c659]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[688db7ea-06c9-4684-abd3-e9f364028bb4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59a7d8d-9481-47a6-a856-cf6b0e55ddca]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIyprYEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:22:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-deleted-68c624f1-a380-4397-b311-6104fad344a8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:42 user nova-compute[71285]: INFO nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Neutron deleted interface 68c624f1-a380-4397-b311-6104fad344a8; detaching it from the instance and deleting it from the info cache
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3deaefd-62cd-4147-b744-783c9f5ff678", "address": "fa:16:3e:55:e0:68", "network": {"id": "8e5e046b-8f60-4247-9c4e-cec1d1352bd2", "bridge": "br-int", "label": "tempest-device-tagging-net2-685093109", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3deaefd-62", "ovs_interfaceid": "b3deaefd-62cd-4147-b744-783c9f5ff678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Detach interface failed, port_id=68c624f1-a380-4397-b311-6104fad344a8, reason: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-deleted-b3deaefd-62cd-4147-b744-783c9f5ff678 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:42 user nova-compute[71285]: INFO nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Neutron deleted interface b3deaefd-62cd-4147-b744-783c9f5ff678; detaching it from the instance and deleting it from the info cache
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "address": "fa:16:3e:83:28:28", "network": {"id": "17186205-53ed-4e04-8d16-ac48ae498058", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1994490230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2c1c646-b6", "ovs_interfaceid": "b2c1c646-b65c-4543-bf25-b89ff954fdd1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23137333634646539', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137333634646539', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Detach interface failed, port_id=b3deaefd-62cd-4147-b744-783c9f5ff678, reason: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-deleted-b2c1c646-b65c-4543-bf25-b89ff954fdd1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:42 user nova-compute[71285]: INFO nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Neutron deleted interface b2c1c646-b65c-4543-bf25-b89ff954fdd1; detaching it from the instance and deleting it from the info cache
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [{"id": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "address": "fa:16:3e:eb:78:b7", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58a1b4af-74", "ovs_interfaceid": "58a1b4af-7470-4cef-8c7a-7e611f8942fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "address": "fa:16:3e:7d:86:66", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51a691d6-af", "ovs_interfaceid": "51a691d6-af80-4126-9fa3-99fd3ee39a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0fc22c68-14c3-4803-952d-32dac032db89", "address": "fa:16:3e:3a:1e:06", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fc22c68-14", "ovs_interfaceid": "0fc22c68-14c3-4803-952d-32dac032db89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ee2ced5f-3757-4527-a93f-72d920a58291", "address": "fa:16:3e:98:0c:0e", "network": {"id": "a081e803-ef34-4744-8355-532db29d9e29", "bridge": "br-int", "label": "tempest-device-tagging-net1-1434071120", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.123", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9ced32cd96594324b6b8792ef56e28c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee2ced5f-37", "ovs_interfaceid": "ee2ced5f-3757-4527-a93f-72d920a58291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:22:42 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:42 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:22:42 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:22:42 user nova-compute[71285]:   <serial>14b662bc-beb2-4e07-bd32-8d54ee3e1748</serial>
Apr 13 20:22:42 user nova-compute[71285]: </disk>
Apr 13 20:22:42 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-3bd1d466-2f77-4331-83f0-a5ecedd253bd req-c6c5ede3-771f-4e1e-a5a9-91e28963189c service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Detach interface failed, port_id=b2c1c646-b65c-4543-bf25-b89ff954fdd1, reason: Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417347.8744535, 4586f280-bf80-4ec1-b5bd-b51c11dc4d38 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:42 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] VM Stopped (Lifecycle Event)
Apr 13 20:22:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2c39cfcc-fd6d-42e5-83b9-30485373a2b3 None None] [instance: 4586f280-bf80-4ec1-b5bd-b51c11dc4d38] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:43 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Took 3.90 seconds to deallocate network for instance.
Apr 13 20:22:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No VIF found with MAC fa:16:3e:58:bb:03, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8736a750-c585-4cb4-964f-9579bdb92540 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.222s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:22:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7998MB free_disk=26.635913848876953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-deleted-ee2ced5f-3757-4527-a93f-72d920a58291 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-964b008e-08f0-4f51-890f-ab7063f95f48 req-930dec47-fb40-48e3-8aff-7cec6b1eb57e service nova] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Received event network-vif-deleted-0fc22c68-14c3-4803-952d-32dac032db89 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 66835d12-d155-4684-a9f0-41587936af9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:44 user nova-compute[71285]: INFO nova.compute.manager [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Unshelving
Apr 13 20:22:44 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:22:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:45 user nova-compute[71285]: INFO nova.virt.block_device [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Booting with volume 1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c at /dev/vdc
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.utils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3930c7-a023-46fb-a5ae-131122228dd7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[650ee0e3-14ac-4dfb-a27d-be0cde02e419]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b496c27-200d-405f-a2ab-8fe3bf1df8b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[759283b1-79c7-420a-bbb9-a753e0f225ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:22:45 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ee93a1-51b7-4594-87e9-6e9b9228cd9c]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG os_brick.utils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating existing volume attachment record: 248bf435-1095-41c1-a1ec-0088d1e90ce6 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:46 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:46 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:46 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb51970a-849a-439b-af3e-81ef92552704]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:22:46 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[75367367-4975-429a-bee4-a1f9634aaa4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb] added
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d45fd09-e7d1-4a03-8d0a-3d5221d3404a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Detaching volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf88b856-9f0a-4a01-bf21-9a462f2333ae]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrlGRomW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrlGRomW" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9811de-72bd-432c-b32b-2d871f76df86]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrlGRomW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07005f28-2e4e-4ffb-8108-9759993b293a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a60b8eb-9c2a-4040-9ee8-451147a15f1a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:46 user nova-compute[71285]: INFO nova.virt.block_device [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Attempting to driver detach volume 14b662bc-beb2-4e07-bd32-8d54ee3e1748 from mountpoint /dev/vdb
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Attempting to detach device vdb from instance b9e0bb04-2572-4973-af9c-a607ca0b170b from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:22:46 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:46 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:22:46 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:22:46 user nova-compute[71285]:   <serial>14b662bc-beb2-4e07-bd32-8d54ee3e1748</serial>
Apr 13 20:22:46 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:22:46 user nova-compute[71285]: </disk>
Apr 13 20:22:46 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:22:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully detached device vdb from instance b9e0bb04-2572-4973-af9c-a607ca0b170b from the persistent domain config.
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9e0bb04-2572-4973-af9c-a607ca0b170b from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:22:46 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:46 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:22:46 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:22:46 user nova-compute[71285]:   <serial>14b662bc-beb2-4e07-bd32-8d54ee3e1748</serial>
Apr 13 20:22:46 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:22:46 user nova-compute[71285]: </disk>
Apr 13 20:22:46 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2873bdfd-db46-4f4d-82b1-53b6c2929bad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260]
Apr 13 20:22:46 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e074039-c9cd-4c41-9590-2e44229a33a6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afd969c-2d4b-413e-b359-33a718f8128f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:46 user nova-compute[71285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:46 user nova-compute[71285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b9eeff-4805-4b92-a3ea-be843a7e2624]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417367.195225, b9e0bb04-2572-4973-af9c-a607ca0b170b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:22:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully detached device vdb from instance b9e0bb04-2572-4973-af9c-a607ca0b170b from the live domain config.
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIyprYEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23137303836313938', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137303836313938', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.685s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'flavor' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e79bca-6d2f-40c0-ad97-074fdde5cecb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:22:47 user nova-compute[71285]: No targets found.
Apr 13 20:22:47 user nova-compute[71285]: iSNS:
Apr 13 20:22:47 user nova-compute[71285]: No targets found.
Apr 13 20:22:47 user nova-compute[71285]: STATIC:
Apr 13 20:22:47 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb
Apr 13 20:22:47 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:47 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:47 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748
Apr 13 20:22:47 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:22:47 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:22:47 user nova-compute[71285]: FIRMWARE:
Apr 13 20:22:47 user nova-compute[71285]: No targets found.
Apr 13 20:22:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:22:47 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:22:47 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:22:47 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:47 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:22:47 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:22:47 user nova-compute[71285]:   <serial>73e8450f-52ed-4e90-83e8-1ba72b5e60cb</serial>
Apr 13 20:22:47 user nova-compute[71285]: </disk>
Apr 13 20:22:47 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61c0b2d-c6d0-4245-8347-ee17dd181576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9ceed0-2564-410b-9968-739e6ce31c91]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:47 user nova-compute[71285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 (non-flash)
Apr 13 20:22:47 user nova-compute[71285]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc642e5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd775d-e9c7-4235-9af1-98b27506784a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cef7c-f105-40da-82e4-a846b6d20046]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fcc312-bc94-468b-97a3-00b2b82785e9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b7109e-727b-400d-8b30-6c29b8a761f9]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46da26f-aa4f-43f1-9ebf-d2fe5f417f52]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a95775-6f93-4e82-974a-a652c7a04f19]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260]
Apr 13 20:22:48 user nova-compute[71285]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:48 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14b662bc-beb2-4e07-bd32-8d54ee3e1748 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fedd824-ce09-425b-a98c-a4262795c2b2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== disconnect_volume: return (973ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No VIF found with MAC fa:16:3e:06:e5:44, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:49 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ab2d15c8-72bf-4c4a-8965-41a3df893595 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.612s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b4e4a605-981f-4dfa-bfcd-093859438225 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.083s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:49 user nova-compute[71285]: INFO nova.compute.manager [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Rescuing
Apr 13 20:22:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:49 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_requests' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:22:50 user nova-compute[71285]: INFO nova.compute.claims [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Claim successful on node user
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:50 user nova-compute[71285]: INFO nova.network.neutron [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating port df3a82f9-8c19-424c-a1b3-3332149ac690 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:50 user nova-compute[71285]: WARNING nova.compute.manager [req-2d17345e-6ace-4df1-ad40-506823fa3d40 req-0f409f14-5d73-4458-938d-982f32119362 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state rescuing.
Apr 13 20:22:51 user nova-compute[71285]: INFO nova.compute.manager [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Took 8.05 seconds to detach 3 volumes for instance.
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance destroyed successfully.
Apr 13 20:22:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attempting a stable device rescue
Apr 13 20:22:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:22:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Creating image(s)
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'trusted_certs' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:51 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Deleted allocations for instance 8587fcac-cc5b-4fe7-92f9-8bf675a9a872
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8a8d9484-7641-4a7f-977f-dfca9562b3d7 tempest-TaggedBootDevicesTest-619300676 tempest-TaggedBootDevicesTest-619300676-project-member] Lock "8587fcac-cc5b-4fe7-92f9-8bf675a9a872" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.882s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417357.5825672, 8587fcac-cc5b-4fe7-92f9-8bf675a9a872 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:52 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] VM Stopped (Lifecycle Event)
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417357.5993714, da17669c-1ea2-450a-8183-40b47c4f41fc => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:52 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] VM Stopped (Lifecycle Event)
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5a868e68-c37b-4047-8a86-142048e79e2c None None] [instance: 8587fcac-cc5b-4fe7-92f9-8bf675a9a872] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-cde121aa-556f-421c-a096-deeee3a397eb None None] [instance: da17669c-1ea2-450a-8183-40b47c4f41fc] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.part --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.virt.images [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] 3acc4cf1-db6f-405d-8695-ddaf35363cfe was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.part /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.part /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.converted" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.423s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:53 user nova-compute[71285]: WARNING nova.compute.manager [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state rescuing.
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing instance network info cache due to event network-changed-df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9 --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9,backing_fmt=raw /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:22:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Creating image(s)
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Refreshing network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9,backing_fmt=raw /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue" returned: 0 in 0.057s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "a4a7cc193193e7d73f5a0f1479006918609ae7e9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'migration_context' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start _get_guest_xml network_info=[{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "vif_mac": "fa:16:3e:06:e5:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3acc4cf1-db6f-405d-8695-ddaf35363cfe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '54d25a51-cd3f-4ea1-9de4-66de37fcb476', 'attached_at': '', 'detached_at': '', 'volume_id': '73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'serial': '73e8450f-52ed-4e90-83e8-1ba72b5e60cb'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '15fe5c85-041d-458e-96f0-ec9093181697', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'resources' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'numa_topology' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:53 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:53 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:53 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56ef3a5-97c4-4718-8e0f-382afaed134f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CrlGRomW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 20:22:54 user nova-compute[71285]: node.name = iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb
Apr 13 20:22:54 user nova-compute[71285]: node.tpgt = -1
Apr 13 20:22:54 user nova-compute[71285]: node.startup = automatic
Apr 13 20:22:54 user nova-compute[71285]: node.leading_login = No
Apr 13 20:22:54 user nova-compute[71285]: iface.iscsi_ifacename = default
Apr 13 20:22:54 user nova-compute[71285]: iface.net_ifacename = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.ipaddress = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.prefix_len = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.hwaddress = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.transport_name = tcp
Apr 13 20:22:54 user nova-compute[71285]: iface.initiatorname = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.vlan_id = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.vlan_priority = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.vlan_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.iface_num = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.mtu = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.port = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.bootproto = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.subnet_mask = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.gateway = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_alt_client_id = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_dns = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_learn_iqn = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_vendor_id_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_vendor_id = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.dhcp_slp_da = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.fragmentation = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.gratuitous_arp = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.incoming_forwarding = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.tos_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.tos = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.ttl = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.delayed_ack = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.tcp_nagle = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.tcp_wsf_state = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.tcp_wsf = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.tcp_timer_scale = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.tcp_timestamp = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.redirect = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.def_task_mgmt_timeout = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.header_digest = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.data_digest = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.immediate_data = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.initial_r2t = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.data_seq_inorder = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.data_pdu_inorder = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.erl = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.max_receive_data_len = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.first_burst_len = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.max_outstanding_r2t = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.max_burst_len = 0
Apr 13 20:22:54 user nova-compute[71285]: iface.chap_auth = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.bidi_chap = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.strict_login_compliance = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.discovery_auth = <empty>
Apr 13 20:22:54 user nova-compute[71285]: iface.discovery_logout = <empty>
Apr 13 20:22:54 user nova-compute[71285]: node.discovery_address = <empty>
Apr 13 20:22:54 user nova-compute[71285]: node.discovery_port = 0
Apr 13 20:22:54 user nova-compute[71285]: node.discovery_type = static
Apr 13 20:22:54 user nova-compute[71285]: node.session.initial_cmdsn = 0
Apr 13 20:22:54 user nova-compute[71285]: node.session.initial_login_retry_max = 8
Apr 13 20:22:54 user nova-compute[71285]: node.session.xmit_thread_priority = -20
Apr 13 20:22:54 user nova-compute[71285]: node.session.cmds_max = 128
Apr 13 20:22:54 user nova-compute[71285]: node.session.queue_depth = 32
Apr 13 20:22:54 user nova-compute[71285]: node.session.nr_sessions = 1
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.authmethod = CHAP
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.username = CrlGRomW
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.password = ***
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.username_in = <empty>
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.password_in = <empty>
Apr 13 20:22:54 user nova-compute[71285]: node.session.auth.chap_algs = MD5
Apr 13 20:22:54 user nova-compute[71285]: node.session.timeo.replacement_timeout = 120
Apr 13 20:22:54 user nova-compute[71285]: node.session.err_timeo.abort_timeout = 15
Apr 13 20:22:54 user nova-compute[71285]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 20:22:54 user nova-compute[71285]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 20:22:54 user nova-compute[71285]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.FastAbort = Yes
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.InitialR2T = No
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.ImmediateData = Yes
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.MaxConnections = 1
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 20:22:54 user nova-compute[71285]: node.session.iscsi.ERL = 0
Apr 13 20:22:54 user nova-compute[71285]: node.session.scan = manual
Apr 13 20:22:54 user nova-compute[71285]: node.session.reopen_max = 0
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].address = 172.16.0.220
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].port = 3260
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].startup = manual
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].tcp.window_size = 524288
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].tcp.type_of_service = 0
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].timeo.logout_timeout = 15
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].timeo.login_timeout = 15
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].timeo.auth_timeout = 45
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.DataDigest = None
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.IFMarker = No
Apr 13 20:22:54 user nova-compute[71285]: node.conn[0].iscsi.OFMarker = No
Apr 13 20:22:54 user nova-compute[71285]: # END RECORD
Apr 13 20:22:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d669437-72b6-48e3-9af0-c63dfad46a3b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3600274-dc15-49a8-8600-5875bff41de7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrlGRomW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrlGRomW" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58a5539-a836-4fc8-bb9b-2bdd1ea79a7e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrlGRomW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.images [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] a76a99e5-65d1-4a80-a052-6ac65e85aeb3 was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.part /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade43dc-bf6c-4900-9936-6d46f651ec4e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[907897e4-3167-4bc6-adc3-f5eb125fc67c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.806s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e45069-1172-4c8b-ad19-4da531017a36]: (4, ('0 0 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.835s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] <== connect_volume: return (836ms) {'type': 'block', 'scsi_wwn': '23137303836313938', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137303836313938', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-348825334',display_name='tempest-ServerStableDeviceRescueTest-server-348825334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-348825334',id=1,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1U5QECB3FwD62l+VoD4RcrdT4EaNcIQSWZpqPdFG+5sUJl6aJ5L9iAijKA5SZiYUs+UXX2i0SuapMZsoqaM+jDDv+ifTc3jkJuvkYwnliPrzr/xR1kynUx8tBW306ag==',key_name='tempest-keypair-1968906009',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c3042be539b4749b37156c0e5a9d907',ramdisk_id='',reservation_id='r-pm90g9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1796731705',owner_user_name='tempest-ServerStableDeviceRescueTest-1796731705-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:20:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb2df6092c342e0b0f44c37abb4a88a',uuid=54d25a51-cd3f-4ea1-9de4-66de37fcb476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "vif_mac": "fa:16:3e:06:e5:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converting VIF {"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "vif_mac": "fa:16:3e:06:e5:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'pci_devices' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.part /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.converted" returned: 0 in 0.206s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:22:54 user nova-compute[71285]:   <uuid>54d25a51-cd3f-4ea1-9de4-66de37fcb476</uuid>
Apr 13 20:22:54 user nova-compute[71285]:   <name>instance-00000001</name>
Apr 13 20:22:54 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:22:54 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:22:54 user nova-compute[71285]:   <metadata>
Apr 13 20:22:54 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:22:54 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-348825334</nova:name>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:22:53</nova:creationTime>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:22:54 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:22:54 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:owner>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:user uuid="5cb2df6092c342e0b0f44c37abb4a88a">tempest-ServerStableDeviceRescueTest-1796731705-project-member</nova:user>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:project uuid="4c3042be539b4749b37156c0e5a9d907">tempest-ServerStableDeviceRescueTest-1796731705</nova:project>
Apr 13 20:22:54 user nova-compute[71285]:       </nova:owner>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:22:54 user nova-compute[71285]:       <nova:ports>
Apr 13 20:22:54 user nova-compute[71285]:         <nova:port uuid="55d65e58-cf52-4044-a5c3-b7d5c4bf4bad">
Apr 13 20:22:54 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 20:22:54 user nova-compute[71285]:         </nova:port>
Apr 13 20:22:54 user nova-compute[71285]:       </nova:ports>
Apr 13 20:22:54 user nova-compute[71285]:     </nova:instance>
Apr 13 20:22:54 user nova-compute[71285]:   </metadata>
Apr 13 20:22:54 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:22:54 user nova-compute[71285]:     <system>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="serial">54d25a51-cd3f-4ea1-9de4-66de37fcb476</entry>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="uuid">54d25a51-cd3f-4ea1-9de4-66de37fcb476</entry>
Apr 13 20:22:54 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:22:54 user nova-compute[71285]:     </system>
Apr 13 20:22:54 user nova-compute[71285]:   </sysinfo>
Apr 13 20:22:54 user nova-compute[71285]:   <os>
Apr 13 20:22:54 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:22:54 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:22:54 user nova-compute[71285]:   </os>
Apr 13 20:22:54 user nova-compute[71285]:   <features>
Apr 13 20:22:54 user nova-compute[71285]:     <acpi/>
Apr 13 20:22:54 user nova-compute[71285]:     <apic/>
Apr 13 20:22:54 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:22:54 user nova-compute[71285]:   </features>
Apr 13 20:22:54 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:22:54 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:22:54 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:22:54 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:22:54 user nova-compute[71285]:   </clock>
Apr 13 20:22:54 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:22:54 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:22:54 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:22:54 user nova-compute[71285]:   </cpu>
Apr 13 20:22:54 user nova-compute[71285]:   <devices>
Apr 13 20:22:54 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:22:54 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:22:54 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk"/>
Apr 13 20:22:54 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:22:54 user nova-compute[71285]:     </disk>
Apr 13 20:22:54 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:22:54 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:54 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:22:54 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:22:54 user nova-compute[71285]:       <serial>73e8450f-52ed-4e90-83e8-1ba72b5e60cb</serial>
Apr 13 20:22:54 user nova-compute[71285]:     </disk>
Apr 13 20:22:54 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:22:54 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:22:54 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue"/>
Apr 13 20:22:54 user nova-compute[71285]:       <target dev="vdc" bus="virtio"/>
Apr 13 20:22:54 user nova-compute[71285]:       <boot order="1"/>
Apr 13 20:22:54 user nova-compute[71285]:     </disk>
Apr 13 20:22:54 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:22:54 user nova-compute[71285]:       <mac address="fa:16:3e:06:e5:44"/>
Apr 13 20:22:54 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:54 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:22:54 user nova-compute[71285]:       <target dev="tap55d65e58-cf"/>
Apr 13 20:22:54 user nova-compute[71285]:     </interface>
Apr 13 20:22:54 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:22:54 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/console.log" append="off"/>
Apr 13 20:22:54 user nova-compute[71285]:     </serial>
Apr 13 20:22:54 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:22:54 user nova-compute[71285]:     <video>
Apr 13 20:22:54 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:54 user nova-compute[71285]:     </video>
Apr 13 20:22:54 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:22:54 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:22:54 user nova-compute[71285]:     </rng>
Apr 13 20:22:54 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:22:54 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:22:54 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:22:54 user nova-compute[71285]:     </memballoon>
Apr 13 20:22:54 user nova-compute[71285]:   </devices>
Apr 13 20:22:54 user nova-compute[71285]: </domain>
Apr 13 20:22:54 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:22:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance destroyed successfully.
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] No VIF found with MAC fa:16:3e:06:e5:44, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87.converted --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.213s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updated VIF entry in instance network info cache for port df3a82f9-8c19-424c-a1b3-3332149ac690. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-047e134d-89bd-4f2b-aeec-c6fd7367ee12 req-3e3f746a-3fd1-43ae-ac18-6208d1efe100 service nova] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87,backing_fmt=raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87,backing_fmt=raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk 1073741824" returned: 0 in 0.045s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "0424c0966d7a74b9e75f9ea2f543f076317deb87" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'migration_context' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Rebasing disk image.
Apr 13 20:22:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 -F raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:56 user nova-compute[71285]: WARNING nova.compute.manager [req-f0b56a64-95b1-476f-984e-9264f9d80b2f req-d1171327-8243-455e-a39d-c903c61cbd6a service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state rescuing.
Apr 13 20:22:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 -F raw /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk" returned: 0 in 2.213s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Ensure instance console log exists: /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start _get_guest_xml network_info=[{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b964debae29bcaeed6510e6db0b0b935',container_format='bare',created_at=2023-04-13T20:20:52Z,direct_url=<?>,disk_format='qcow2',id=a76a99e5-65d1-4a80-a052-6ac65e85aeb3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2122692990-shelved',owner='405aed9fca044ab39eabe188942230d2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T20:20:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaYmVwEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9', 'attached_at': '', 'detached_at': '', 'volume_id': '1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 'serial': '1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '248bf435-1095-41c1-a1ec-0088d1e90ce6', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:22:57 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:57 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b964debae29bcaeed6510e6db0b0b935',container_format='bare',created_at=2023-04-13T20:20:52Z,direct_url=<?>,disk_format='qcow2',id=a76a99e5-65d1-4a80-a052-6ac65e85aeb3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2122692990-shelved',owner='405aed9fca044ab39eabe188942230d2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T20:20:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaYmVwEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:22:57 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:57 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:22:57 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd4ed9f-3b37-4fc5-9de6-29a4b613bce9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:22:57 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f7333d-f3aa-4006-b9f7-f08915cb5f54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c] added
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec924d-28f9-41d5-bcdd-f0686d45f865]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f054d71-a72d-4a56-abb5-3b891599bf85]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaYmVwEH {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaYmVwEH" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4a47ea-d46a-4f13-9fe3-ae7a18ecc71f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zaYmVwEH'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[928f6279-a912-4f47-a78f-1830646f463b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b3c28b-fa3b-4495-83a9-b48334d93eb7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cdacd6-69d3-47a3-890b-7db4fbea3154]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260]
Apr 13 20:22:57 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260] successful.
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c11008-b0ab-4ed2-9783-f7640c7eb5ad]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b9070-40bf-4fc1-b25e-3b0e26d06f4a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:57 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:22:57 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:22:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ed2ab-2aa5-4774-a491-e6e9fa21bd06]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:22:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaYmVwEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:22:58 user nova-compute[71285]: WARNING nova.compute.manager [req-1478039f-1909-45f8-a11b-c95e401e904a req-75415e59-4d10-4970-ae9a-8a23bf6193cb service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state active and task_state rescuing.
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 54d25a51-cd3f-4ea1-9de4-66de37fcb476 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417378.1826987, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Resumed (Lifecycle Event)
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7e568e27-5fdb-4be5-b317-3cf31c2f22f8 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417378.1854465, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:22:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Started (Lifecycle Event)
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26633343933343936', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633343933343936', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='a76a99e5-65d1-4a80-a052-6ac65e85aeb3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1146136459',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:20:56.949999',shelved_host='user',shelved_image_id='a76a99e5-65d1-4a80-a052-6ac65e85aeb3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:22:58 user nova-compute[71285]:   <uuid>2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</uuid>
Apr 13 20:22:58 user nova-compute[71285]:   <name>instance-00000003</name>
Apr 13 20:22:58 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:22:58 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:22:58 user nova-compute[71285]:   <metadata>
Apr 13 20:22:58 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:22:58 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2122692990</nova:name>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:22:57</nova:creationTime>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:22:58 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:22:58 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:owner>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:user uuid="36e11efc98604eb7a8d5b95563431e45">tempest-AttachVolumeShelveTestJSON-160294736-project-member</nova:user>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:project uuid="405aed9fca044ab39eabe188942230d2">tempest-AttachVolumeShelveTestJSON-160294736</nova:project>
Apr 13 20:22:58 user nova-compute[71285]:       </nova:owner>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:root type="image" uuid="a76a99e5-65d1-4a80-a052-6ac65e85aeb3"/>
Apr 13 20:22:58 user nova-compute[71285]:       <nova:ports>
Apr 13 20:22:58 user nova-compute[71285]:         <nova:port uuid="df3a82f9-8c19-424c-a1b3-3332149ac690">
Apr 13 20:22:58 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:22:58 user nova-compute[71285]:         </nova:port>
Apr 13 20:22:58 user nova-compute[71285]:       </nova:ports>
Apr 13 20:22:58 user nova-compute[71285]:     </nova:instance>
Apr 13 20:22:58 user nova-compute[71285]:   </metadata>
Apr 13 20:22:58 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:22:58 user nova-compute[71285]:     <system>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="serial">2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</entry>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="uuid">2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9</entry>
Apr 13 20:22:58 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:22:58 user nova-compute[71285]:     </system>
Apr 13 20:22:58 user nova-compute[71285]:   </sysinfo>
Apr 13 20:22:58 user nova-compute[71285]:   <os>
Apr 13 20:22:58 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:22:58 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:22:58 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:22:58 user nova-compute[71285]:   </os>
Apr 13 20:22:58 user nova-compute[71285]:   <features>
Apr 13 20:22:58 user nova-compute[71285]:     <acpi/>
Apr 13 20:22:58 user nova-compute[71285]:     <apic/>
Apr 13 20:22:58 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:22:58 user nova-compute[71285]:   </features>
Apr 13 20:22:58 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:22:58 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:22:58 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:22:58 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:22:58 user nova-compute[71285]:   </clock>
Apr 13 20:22:58 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:22:58 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:22:58 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:22:58 user nova-compute[71285]:   </cpu>
Apr 13 20:22:58 user nova-compute[71285]:   <devices>
Apr 13 20:22:58 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:22:58 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:22:58 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk"/>
Apr 13 20:22:58 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:22:58 user nova-compute[71285]:     </disk>
Apr 13 20:22:58 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:22:58 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:22:58 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:22:58 user nova-compute[71285]:       <target dev="vdc" bus="virtio"/>
Apr 13 20:22:58 user nova-compute[71285]:       <serial>1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c</serial>
Apr 13 20:22:58 user nova-compute[71285]:     </disk>
Apr 13 20:22:58 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:22:58 user nova-compute[71285]:       <mac address="fa:16:3e:a6:7e:d3"/>
Apr 13 20:22:58 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:58 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:22:58 user nova-compute[71285]:       <target dev="tapdf3a82f9-8c"/>
Apr 13 20:22:58 user nova-compute[71285]:     </interface>
Apr 13 20:22:58 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:22:58 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/console.log" append="off"/>
Apr 13 20:22:58 user nova-compute[71285]:     </serial>
Apr 13 20:22:58 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:22:58 user nova-compute[71285]:     <video>
Apr 13 20:22:58 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:22:58 user nova-compute[71285]:     </video>
Apr 13 20:22:58 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:22:58 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:22:58 user nova-compute[71285]:     </rng>
Apr 13 20:22:58 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:22:58 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:22:58 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:22:58 user nova-compute[71285]:     </memballoon>
Apr 13 20:22:58 user nova-compute[71285]:   </devices>
Apr 13 20:22:58 user nova-compute[71285]: </domain>
Apr 13 20:22:58 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='a76a99e5-65d1-4a80-a052-6ac65e85aeb3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1146136459',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:20:56.949999',shelved_host='user',shelved_image_id='a76a99e5-65d1-4a80-a052-6ac65e85aeb3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG os_vif [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf3a82f9-8c, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdf3a82f9-8c, col_values=(('external_ids', {'iface-id': 'df3a82f9-8c19-424c-a1b3-3332149ac690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:7e:d3', 'vm-uuid': '2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:22:58 user nova-compute[71285]: INFO os_vif [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c')
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:22:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No VIF found with MAC fa:16:3e:a6:7e:d3, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:22:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:01 user nova-compute[71285]: WARNING nova.compute.manager [req-c84f3372-701c-4bb1-8f46-4e38879352c0 req-dde6168c-cd48-487e-8d0f-75c37d12e037 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:23:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417383.273016, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:03 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Resumed (Lifecycle Event)
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:23:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance spawned successfully.
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:03 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417383.2734149, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:03 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Started (Lifecycle Event)
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:03 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:03 user nova-compute[71285]: WARNING nova.compute.manager [req-686832d6-ea4e-4836-9810-2e4830c9bba9 req-1555f08a-c1ff-4ebb-99ce-86ad55f4e220 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:23:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-59c9f3c9-903b-41dc-b7c4-e56a1c89b208 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.724s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:23:16 user nova-compute[71285]: INFO nova.compute.claims [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Claim successful on node user
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:23:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.policy [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:23:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Creating image(s)
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "/opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "/opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "/opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.240s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk 1073741824" returned: 0 in 0.062s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.157s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Cannot resize image /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'migration_context' on Instance uuid 57c6121a-c1be-467c-888f-1c42b03f95cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Ensure instance console log exists: /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Successfully created port: 5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Successfully updated port: 5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquired lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-changed-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Refreshing instance network info cache due to event network-changed-5d781018-f7d5-445e-9d00-55c8ff93194c. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Acquiring lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:23:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.neutron [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updating instance_info_cache with network_info: [{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Releasing lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Instance network_info: |[{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Acquired lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Refreshing network info cache for port 5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Start _get_guest_xml network_info=[{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:23:19 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:19 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1107246113',display_name='tempest-ServersNegativeTestJSON-server-1107246113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1107246113',id=14,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-k2z9yhnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:17Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=57c6121a-c1be-467c-888f-1c42b03f95cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.objects.instance [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'pci_devices' on Instance uuid 57c6121a-c1be-467c-888f-1c42b03f95cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:23:19 user nova-compute[71285]:   <uuid>57c6121a-c1be-467c-888f-1c42b03f95cf</uuid>
Apr 13 20:23:19 user nova-compute[71285]:   <name>instance-0000000e</name>
Apr 13 20:23:19 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:23:19 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:23:19 user nova-compute[71285]:   <metadata>
Apr 13 20:23:19 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:23:19 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:name>tempest-ServersNegativeTestJSON-server-1107246113</nova:name>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:23:19</nova:creationTime>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:23:19 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:23:19 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:owner>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:user uuid="e39152c6dfed4218aa473532c49844ff">tempest-ServersNegativeTestJSON-1377252178-project-member</nova:user>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:project uuid="376fa6e005894aee80e4398704d956a7">tempest-ServersNegativeTestJSON-1377252178</nova:project>
Apr 13 20:23:19 user nova-compute[71285]:       </nova:owner>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:23:19 user nova-compute[71285]:       <nova:ports>
Apr 13 20:23:19 user nova-compute[71285]:         <nova:port uuid="5d781018-f7d5-445e-9d00-55c8ff93194c">
Apr 13 20:23:19 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:23:19 user nova-compute[71285]:         </nova:port>
Apr 13 20:23:19 user nova-compute[71285]:       </nova:ports>
Apr 13 20:23:19 user nova-compute[71285]:     </nova:instance>
Apr 13 20:23:19 user nova-compute[71285]:   </metadata>
Apr 13 20:23:19 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:23:19 user nova-compute[71285]:     <system>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="serial">57c6121a-c1be-467c-888f-1c42b03f95cf</entry>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="uuid">57c6121a-c1be-467c-888f-1c42b03f95cf</entry>
Apr 13 20:23:19 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:23:19 user nova-compute[71285]:     </system>
Apr 13 20:23:19 user nova-compute[71285]:   </sysinfo>
Apr 13 20:23:19 user nova-compute[71285]:   <os>
Apr 13 20:23:19 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:23:19 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:23:19 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:23:19 user nova-compute[71285]:   </os>
Apr 13 20:23:19 user nova-compute[71285]:   <features>
Apr 13 20:23:19 user nova-compute[71285]:     <acpi/>
Apr 13 20:23:19 user nova-compute[71285]:     <apic/>
Apr 13 20:23:19 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:23:19 user nova-compute[71285]:   </features>
Apr 13 20:23:19 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:23:19 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:23:19 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:23:19 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:23:19 user nova-compute[71285]:   </clock>
Apr 13 20:23:19 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:23:19 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:23:19 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:23:19 user nova-compute[71285]:   </cpu>
Apr 13 20:23:19 user nova-compute[71285]:   <devices>
Apr 13 20:23:19 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:23:19 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:23:19 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk"/>
Apr 13 20:23:19 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:23:19 user nova-compute[71285]:     </disk>
Apr 13 20:23:19 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:23:19 user nova-compute[71285]:       <mac address="fa:16:3e:5f:ba:30"/>
Apr 13 20:23:19 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:19 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:23:19 user nova-compute[71285]:       <target dev="tap5d781018-f7"/>
Apr 13 20:23:19 user nova-compute[71285]:     </interface>
Apr 13 20:23:19 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:23:19 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/console.log" append="off"/>
Apr 13 20:23:19 user nova-compute[71285]:     </serial>
Apr 13 20:23:19 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:23:19 user nova-compute[71285]:     <video>
Apr 13 20:23:19 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:19 user nova-compute[71285]:     </video>
Apr 13 20:23:19 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:23:19 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:23:19 user nova-compute[71285]:     </rng>
Apr 13 20:23:19 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:23:19 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:23:19 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:23:19 user nova-compute[71285]:     </memballoon>
Apr 13 20:23:19 user nova-compute[71285]:   </devices>
Apr 13 20:23:19 user nova-compute[71285]: </domain>
Apr 13 20:23:19 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1107246113',display_name='tempest-ServersNegativeTestJSON-server-1107246113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1107246113',id=14,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-k2z9yhnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:17Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=57c6121a-c1be-467c-888f-1c42b03f95cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG os_vif [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d781018-f7, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d781018-f7, col_values=(('external_ids', {'iface-id': '5d781018-f7d5-445e-9d00-55c8ff93194c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ba:30', 'vm-uuid': '57c6121a-c1be-467c-888f-1c42b03f95cf'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:19 user nova-compute[71285]: INFO os_vif [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7')
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] No VIF found with MAC fa:16:3e:5f:ba:30, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updated VIF entry in instance network info cache for port 5d781018-f7d5-445e-9d00-55c8ff93194c. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updating instance_info_cache with network_info: [{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7547f6fa-3e59-43c8-9dac-38cd875ecd6b req-ff776631-0e96-4a6f-a909-f382d823595c service nova] Releasing lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] No waiting events found dispatching network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:20 user nova-compute[71285]: WARNING nova.compute.manager [req-8dab88bf-a672-4231-8d7b-220fcd76e64e req-a869d62e-2adc-490d-ad8d-d9f2988cd85f service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received unexpected event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c for instance with vm_state building and task_state spawning.
Apr 13 20:23:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] No waiting events found dispatching network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:22 user nova-compute[71285]: WARNING nova.compute.manager [req-1cc7ba36-c7dc-47f1-a94b-d79d6c9795b8 req-c39bb4e1-8d55-40fd-b1d2-3896a7fc3a85 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received unexpected event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c for instance with vm_state building and task_state spawning.
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417403.039163, 57c6121a-c1be-467c-888f-1c42b03f95cf => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] VM Resumed (Lifecycle Event)
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Instance spawned successfully.
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417403.0434916, 57c6121a-c1be-467c-888f-1c42b03f95cf => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] VM Started (Lifecycle Event)
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Took 6.54 seconds to spawn the instance on the hypervisor.
Apr 13 20:23:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:23 user nova-compute[71285]: INFO nova.compute.manager [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Took 7.41 seconds to build instance.
Apr 13 20:23:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-986e2551-78a9-4325-9359-0a88094acac6 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.507s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:23:37 user nova-compute[71285]: INFO nova.compute.claims [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Claim successful on node user
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:23:37 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.policy [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:23:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Creating image(s)
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:23:38 user nova-compute[71285]: INFO nova.compute.claims [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Claim successful on node user
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.201s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk 1073741824" returned: 0 in 0.050s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Cannot resize image /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.objects.instance [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Successfully created port: 374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Ensure instance console log exists: /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:23:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:23:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:23:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Creating image(s)
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.policy [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.171s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk 1073741824" returned: 0 in 0.060s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.188s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Successfully updated port: 374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-changed-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Refreshing instance network info cache due to event network-changed-374f6442-f0a3-4801-a43f-4566b1aec40b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Cannot resize image /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Ensure instance console log exists: /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:23:39 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Successfully created port: ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance network_info: |[{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Refreshing network info cache for port 374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start _get_guest_xml network_info=[{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:23:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:40 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1930901382',display_name='tempest-ServerRescueNegativeTestJSON-server-1930901382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1930901382',id=15,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-dkdzfdu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:38Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=00d20026-e9af-4587-8930-d3dcfdb1ea3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.objects.instance [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:23:40 user nova-compute[71285]:   <uuid>00d20026-e9af-4587-8930-d3dcfdb1ea3e</uuid>
Apr 13 20:23:40 user nova-compute[71285]:   <name>instance-0000000f</name>
Apr 13 20:23:40 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:23:40 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:23:40 user nova-compute[71285]:   <metadata>
Apr 13 20:23:40 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:23:40 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1930901382</nova:name>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:23:40</nova:creationTime>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:23:40 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:23:40 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:owner>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:23:40 user nova-compute[71285]:       </nova:owner>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:23:40 user nova-compute[71285]:       <nova:ports>
Apr 13 20:23:40 user nova-compute[71285]:         <nova:port uuid="374f6442-f0a3-4801-a43f-4566b1aec40b">
Apr 13 20:23:40 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 20:23:40 user nova-compute[71285]:         </nova:port>
Apr 13 20:23:40 user nova-compute[71285]:       </nova:ports>
Apr 13 20:23:40 user nova-compute[71285]:     </nova:instance>
Apr 13 20:23:40 user nova-compute[71285]:   </metadata>
Apr 13 20:23:40 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:23:40 user nova-compute[71285]:     <system>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="serial">00d20026-e9af-4587-8930-d3dcfdb1ea3e</entry>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="uuid">00d20026-e9af-4587-8930-d3dcfdb1ea3e</entry>
Apr 13 20:23:40 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:23:40 user nova-compute[71285]:     </system>
Apr 13 20:23:40 user nova-compute[71285]:   </sysinfo>
Apr 13 20:23:40 user nova-compute[71285]:   <os>
Apr 13 20:23:40 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:23:40 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:23:40 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:23:40 user nova-compute[71285]:   </os>
Apr 13 20:23:40 user nova-compute[71285]:   <features>
Apr 13 20:23:40 user nova-compute[71285]:     <acpi/>
Apr 13 20:23:40 user nova-compute[71285]:     <apic/>
Apr 13 20:23:40 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:23:40 user nova-compute[71285]:   </features>
Apr 13 20:23:40 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:23:40 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:23:40 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:23:40 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:23:40 user nova-compute[71285]:   </clock>
Apr 13 20:23:40 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:23:40 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:23:40 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:23:40 user nova-compute[71285]:   </cpu>
Apr 13 20:23:40 user nova-compute[71285]:   <devices>
Apr 13 20:23:40 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:23:40 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:23:40 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk"/>
Apr 13 20:23:40 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:23:40 user nova-compute[71285]:     </disk>
Apr 13 20:23:40 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:23:40 user nova-compute[71285]:       <mac address="fa:16:3e:98:81:3c"/>
Apr 13 20:23:40 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:40 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:23:40 user nova-compute[71285]:       <target dev="tap374f6442-f0"/>
Apr 13 20:23:40 user nova-compute[71285]:     </interface>
Apr 13 20:23:40 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:23:40 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/console.log" append="off"/>
Apr 13 20:23:40 user nova-compute[71285]:     </serial>
Apr 13 20:23:40 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:23:40 user nova-compute[71285]:     <video>
Apr 13 20:23:40 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:40 user nova-compute[71285]:     </video>
Apr 13 20:23:40 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:23:40 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:23:40 user nova-compute[71285]:     </rng>
Apr 13 20:23:40 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:23:40 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:23:40 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:23:40 user nova-compute[71285]:     </memballoon>
Apr 13 20:23:40 user nova-compute[71285]:   </devices>
Apr 13 20:23:40 user nova-compute[71285]: </domain>
Apr 13 20:23:40 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1930901382',display_name='tempest-ServerRescueNegativeTestJSON-server-1930901382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1930901382',id=15,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-dkdzfdu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:38Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=00d20026-e9af-4587-8930-d3dcfdb1ea3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG os_vif [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap374f6442-f0, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap374f6442-f0, col_values=(('external_ids', {'iface-id': '374f6442-f0a3-4801-a43f-4566b1aec40b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:81:3c', 'vm-uuid': '00d20026-e9af-4587-8930-d3dcfdb1ea3e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:40 user nova-compute[71285]: INFO os_vif [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0')
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:98:81:3c, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updated VIF entry in instance network info cache for port 374f6442-f0a3-4801-a43f-4566b1aec40b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fc4b619-05ca-4baa-a25b-521452c97695 req-914b7b79-e04a-4f8b-80ad-d45d372ff20a service nova] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Successfully updated port: ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-changed-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Refreshing instance network info cache due to event network-changed-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance network_info: |[{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.neutron [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Refreshing network info cache for port ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start _get_guest_xml network_info=[{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:23:41 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:41 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1131214979',display_name='tempest-ServerRescueNegativeTestJSON-server-1131214979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1131214979',id=16,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-hffpcayr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:39Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=65b84d48-a188-45d4-8720-4036faeaca58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:23:41 user nova-compute[71285]:   <uuid>65b84d48-a188-45d4-8720-4036faeaca58</uuid>
Apr 13 20:23:41 user nova-compute[71285]:   <name>instance-00000010</name>
Apr 13 20:23:41 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:23:41 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:23:41 user nova-compute[71285]:   <metadata>
Apr 13 20:23:41 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:23:41 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1131214979</nova:name>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:23:41</nova:creationTime>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:23:41 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:23:41 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:owner>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:23:41 user nova-compute[71285]:       </nova:owner>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:23:41 user nova-compute[71285]:       <nova:ports>
Apr 13 20:23:41 user nova-compute[71285]:         <nova:port uuid="ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9">
Apr 13 20:23:41 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:23:41 user nova-compute[71285]:         </nova:port>
Apr 13 20:23:41 user nova-compute[71285]:       </nova:ports>
Apr 13 20:23:41 user nova-compute[71285]:     </nova:instance>
Apr 13 20:23:41 user nova-compute[71285]:   </metadata>
Apr 13 20:23:41 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:23:41 user nova-compute[71285]:     <system>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="serial">65b84d48-a188-45d4-8720-4036faeaca58</entry>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="uuid">65b84d48-a188-45d4-8720-4036faeaca58</entry>
Apr 13 20:23:41 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:23:41 user nova-compute[71285]:     </system>
Apr 13 20:23:41 user nova-compute[71285]:   </sysinfo>
Apr 13 20:23:41 user nova-compute[71285]:   <os>
Apr 13 20:23:41 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:23:41 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:23:41 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:23:41 user nova-compute[71285]:   </os>
Apr 13 20:23:41 user nova-compute[71285]:   <features>
Apr 13 20:23:41 user nova-compute[71285]:     <acpi/>
Apr 13 20:23:41 user nova-compute[71285]:     <apic/>
Apr 13 20:23:41 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:23:41 user nova-compute[71285]:   </features>
Apr 13 20:23:41 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:23:41 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:23:41 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:23:41 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:23:41 user nova-compute[71285]:   </clock>
Apr 13 20:23:41 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:23:41 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:23:41 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:23:41 user nova-compute[71285]:   </cpu>
Apr 13 20:23:41 user nova-compute[71285]:   <devices>
Apr 13 20:23:41 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:23:41 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:23:41 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk"/>
Apr 13 20:23:41 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:23:41 user nova-compute[71285]:     </disk>
Apr 13 20:23:41 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:23:41 user nova-compute[71285]:       <mac address="fa:16:3e:3d:86:d0"/>
Apr 13 20:23:41 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:41 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:23:41 user nova-compute[71285]:       <target dev="tapca4ebdd2-ce"/>
Apr 13 20:23:41 user nova-compute[71285]:     </interface>
Apr 13 20:23:41 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:23:41 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/console.log" append="off"/>
Apr 13 20:23:41 user nova-compute[71285]:     </serial>
Apr 13 20:23:41 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:23:41 user nova-compute[71285]:     <video>
Apr 13 20:23:41 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:23:41 user nova-compute[71285]:     </video>
Apr 13 20:23:41 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:23:41 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:23:41 user nova-compute[71285]:     </rng>
Apr 13 20:23:41 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:23:41 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:23:41 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:23:41 user nova-compute[71285]:     </memballoon>
Apr 13 20:23:41 user nova-compute[71285]:   </devices>
Apr 13 20:23:41 user nova-compute[71285]: </domain>
Apr 13 20:23:41 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1131214979',display_name='tempest-ServerRescueNegativeTestJSON-server-1131214979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1131214979',id=16,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-hffpcayr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:39Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=65b84d48-a188-45d4-8720-4036faeaca58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG os_vif [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4ebdd2-ce, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca4ebdd2-ce, col_values=(('external_ids', {'iface-id': 'ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:86:d0', 'vm-uuid': '65b84d48-a188-45d4-8720-4036faeaca58'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:41 user nova-compute[71285]: INFO os_vif [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce')
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:3d:86:d0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.neutron [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updated VIF entry in instance network info cache for port ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG nova.network.neutron [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f9387dc4-b83e-48de-b05c-8300e717e3e5 req-ebb2b424-0606-432d-855a-ddf556e0b93a service nova] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:42 user nova-compute[71285]: INFO nova.compute.manager [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] instance snapshotting
Apr 13 20:23:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Beginning live snapshot process
Apr 13 20:23:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:43 user nova-compute[71285]: WARNING nova.compute.manager [req-c55e4931-3867-4689-b655-0e0ce016c252 req-cf7201d1-395c-414c-aec5-235a17c6945b service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state building and task_state spawning.
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json -f qcow2" returned: 0 in 0.234s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.178s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d.delta 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d.delta 1073741824" returned: 0 in 0.059s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:44 user nova-compute[71285]: WARNING nova.compute.manager [req-c9999045-cb1a-4bf9-962d-5433fd358c2c req-92b772fc-9e7a-4fbd-aef4-0b7c0bb96e89 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state building and task_state spawning.
Apr 13 20:23:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:23:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:45 user nova-compute[71285]: WARNING nova.compute.manager [req-636853a4-0de6-46b3-8572-ef73d4b00151 req-b3b152c3-c8fd-48e4-b90c-1c3ffc4f3ba8 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state building and task_state spawning.
Apr 13 20:23:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] COPY block job progress, current cursor: 8454144 final cursor: 43843584 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:23:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d.delta /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:23:46 user nova-compute[71285]: WARNING nova.compute.manager [req-9a713e09-4de1-4cb5-b91b-1e1f1e298ce0 req-28a11526-b9ea-4cf4-bc7c-392469bab090 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state building and task_state spawning.
Apr 13 20:23:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d.delta /opt/stack/data/nova/instances/snapshots/tmprh3eqaju/4de056d2457b4f2d8994aa6efb23fc9d" returned: 0 in 0.654s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Snapshot extracted, beginning image upload
Apr 13 20:23:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417427.7091835, 65b84d48-a188-45d4-8720-4036faeaca58 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] VM Resumed (Lifecycle Event)
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance spawned successfully.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance spawned successfully.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417427.709939, 65b84d48-a188-45d4-8720-4036faeaca58 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] VM Started (Lifecycle Event)
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417427.7263737, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Resumed (Lifecycle Event)
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Took 8.83 seconds to spawn the instance on the hypervisor.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Took 9.91 seconds to spawn the instance on the hypervisor.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:47 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417427.7374046, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:23:47 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Started (Lifecycle Event)
Apr 13 20:23:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:48 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:48 user nova-compute[71285]: INFO nova.compute.manager [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Took 10.06 seconds to build instance.
Apr 13 20:23:48 user nova-compute[71285]: INFO nova.compute.manager [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Took 10.94 seconds to build instance.
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b0d1472a-b7d4-4c16-819c-2d971ee772a1 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.229s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b84eafb-0df2-4e98-b7e5-bf3cd0570d37 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.180s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:50 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Snapshot image upload complete
Apr 13 20:23:50 user nova-compute[71285]: INFO nova.compute.manager [None req-36b7e35f-0f0e-4fc6-8e9a-c86caf2cecc7 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Took 7.34 seconds to snapshot the instance on the hypervisor.
Apr 13 20:23:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=26.50267791748047GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 66835d12-d155-4684-a9f0-41587936af9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:23:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:23:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-changed-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Refreshing instance network info cache due to event network-changed-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Refreshing network info cache for port b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:23:55 user nova-compute[71285]: DEBUG nova.network.neutron [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updated VIF entry in instance network info cache for port b5b9a9b4-bd38-4cfc-b483-9bae4721fb09. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:23:55 user nova-compute[71285]: DEBUG nova.network.neutron [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:23:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e0eba7bd-cd9d-42ec-b02b-766a538b817b req-07515ce9-bd87-4509-9de5-186ca9cc9bb4 service nova] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:23:56 user nova-compute[71285]: INFO nova.compute.claims [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Claim successful on node user
Apr 13 20:23:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:23:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:57 user nova-compute[71285]: INFO nova.compute.manager [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Attaching volume 6aa89e26-6353-427a-a9ef-10c96effef8e to /dev/vdb
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:23:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Creating image(s)
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "/opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "/opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b840d8cf-26fa-464e-8f8b-7d977c116224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG nova.policy [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29ed39378db34acd835d13c0cacad399', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32350a5bf9a4d8b80c6bc1708387d1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[933d53eb-8051-4913-9d4c-cb7ab2ccdb98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:23:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec54bdc-558c-4cf3-a5d3-f80cd9f54929]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:23:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d7c95-4c34-4940-8e20-e3476c6fc499]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:23:59 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[117fe020-eee8-46f3-b509-42c7d048ce21]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== get_connector_properties: return (1453ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating existing volume attachment record: 168e6c19-050c-41ac-8725-dc276ae61f76 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.part --force-share --output=json" returned: 0 in 0.240s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG nova.virt.images [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 0a3095d4-082a-4c70-84d0-8daaa3d5d513 was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.part /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Successfully created port: 4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.part /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.converted" returned: 0 in 0.408s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.380s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:23:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:00 user nova-compute[71285]: INFO nova.compute.manager [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Terminating instance
Apr 13 20:24:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json" returned: 0 in 0.219s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json" returned: 0 in 0.199s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9,backing_fmt=raw /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9,backing_fmt=raw /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk 1073741824" returned: 0 in 0.095s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "c9287fd5f4e117b56ba12629b13601261cc94cf9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG nova.objects.instance [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'migration_context' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Ensure instance console log exists: /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-unplugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] No waiting events found dispatching network-vif-unplugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-1174c6bf-625e-4d5b-9a05-ca0950ef0072 req-518b2fbe-42ac-4d8f-85c7-d4f4dc4c9da1 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-unplugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:24:01 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Instance destroyed successfully.
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'resources' on Instance uuid 66835d12-d155-4684-a9f0-41587936af9f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-979321445',display_name='tempest-VolumesAdminNegativeTest-server-979321445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-979321445',id=13,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-f72miee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:22:10Z,user_data=None,user_id='7cbfa14567af452db21cb0022514773b',uuid=66835d12-d155-4684-a9f0-41587936af9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "address": "fa:16:3e:ea:f5:ac", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96c19e26-cb", "ovs_interfaceid": "96c19e26-cbdc-46a9-9a5c-59ce6d04e416", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG os_vif [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Successfully updated port: 4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96c19e26-cb, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:24:01 user nova-compute[71285]: INFO os_vif [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:f5:ac,bridge_name='br-int',has_traffic_filtering=True,id=96c19e26-cbdc-46a9-9a5c-59ce6d04e416,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96c19e26-cb')
Apr 13 20:24:01 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Deleting instance files /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f_del
Apr 13 20:24:01 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Deletion of /opt/stack/data/nova/instances/66835d12-d155-4684-a9f0-41587936af9f_del complete
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquired lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:24:01 user nova-compute[71285]: INFO nova.compute.manager [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing instance network info cache due to event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Acquiring lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Releasing lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Instance network_info: |[{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Acquired lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Start _get_guest_xml network_info=[{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='10fd83b0c7eac757f305095d839be53a',container_format='bare',created_at=2023-04-13T20:23:42Z,direct_url=<?>,disk_format='qcow2',id=0a3095d4-082a-4c70-84d0-8daaa3d5d513,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2010973266',owner='d32350a5bf9a4d8b80c6bc1708387d1f',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T20:23:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '0a3095d4-082a-4c70-84d0-8daaa3d5d513'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:24:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10fd83b0c7eac757f305095d839be53a',container_format='bare',created_at=2023-04-13T20:23:42Z,direct_url=<?>,disk_format='qcow2',id=0a3095d4-082a-4c70-84d0-8daaa3d5d513,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2010973266',owner='d32350a5bf9a4d8b80c6bc1708387d1f',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-13T20:23:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1024576911',display_name='tempest-TestStampPattern-server-1024576911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1024576911',id=17,image_ref='0a3095d4-082a-4c70-84d0-8daaa3d5d513',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-w7m8f0lp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9e0bb04-2572-4973-af9c-a607ca0b170b',image_min_disk='1',image_min_ram='0',image_owner_id='d32350a5bf9a4d8b80c6bc1708387d1f',image_owner_project_name='tempest-TestStampPattern-1872935518',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1872935518-project-member',image_user_id='29ed39378db34acd835d13c0cacad399',network_allocated='True',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:57Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=5ae3eea8-5d28-46eb-8e84-86958032a048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.objects.instance [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:24:01 user nova-compute[71285]:   <uuid>5ae3eea8-5d28-46eb-8e84-86958032a048</uuid>
Apr 13 20:24:01 user nova-compute[71285]:   <name>instance-00000011</name>
Apr 13 20:24:01 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:24:01 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:24:01 user nova-compute[71285]:   <metadata>
Apr 13 20:24:01 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:24:01 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:name>tempest-TestStampPattern-server-1024576911</nova:name>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:24:01</nova:creationTime>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:24:01 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:24:01 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:owner>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:user uuid="29ed39378db34acd835d13c0cacad399">tempest-TestStampPattern-1872935518-project-member</nova:user>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:project uuid="d32350a5bf9a4d8b80c6bc1708387d1f">tempest-TestStampPattern-1872935518</nova:project>
Apr 13 20:24:01 user nova-compute[71285]:       </nova:owner>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:root type="image" uuid="0a3095d4-082a-4c70-84d0-8daaa3d5d513"/>
Apr 13 20:24:01 user nova-compute[71285]:       <nova:ports>
Apr 13 20:24:01 user nova-compute[71285]:         <nova:port uuid="4c29a89c-5e3a-42f4-a315-8c579dc498ea">
Apr 13 20:24:01 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:24:01 user nova-compute[71285]:         </nova:port>
Apr 13 20:24:01 user nova-compute[71285]:       </nova:ports>
Apr 13 20:24:01 user nova-compute[71285]:     </nova:instance>
Apr 13 20:24:01 user nova-compute[71285]:   </metadata>
Apr 13 20:24:01 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:24:01 user nova-compute[71285]:     <system>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="serial">5ae3eea8-5d28-46eb-8e84-86958032a048</entry>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="uuid">5ae3eea8-5d28-46eb-8e84-86958032a048</entry>
Apr 13 20:24:01 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:24:01 user nova-compute[71285]:     </system>
Apr 13 20:24:01 user nova-compute[71285]:   </sysinfo>
Apr 13 20:24:01 user nova-compute[71285]:   <os>
Apr 13 20:24:01 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:24:01 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:24:01 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:24:01 user nova-compute[71285]:   </os>
Apr 13 20:24:01 user nova-compute[71285]:   <features>
Apr 13 20:24:01 user nova-compute[71285]:     <acpi/>
Apr 13 20:24:01 user nova-compute[71285]:     <apic/>
Apr 13 20:24:01 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:24:01 user nova-compute[71285]:   </features>
Apr 13 20:24:01 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:24:01 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:24:01 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:24:01 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:24:01 user nova-compute[71285]:   </clock>
Apr 13 20:24:01 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:24:01 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:24:01 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:24:01 user nova-compute[71285]:   </cpu>
Apr 13 20:24:01 user nova-compute[71285]:   <devices>
Apr 13 20:24:01 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:24:01 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:24:01 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk"/>
Apr 13 20:24:01 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:24:01 user nova-compute[71285]:     </disk>
Apr 13 20:24:01 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:24:01 user nova-compute[71285]:       <mac address="fa:16:3e:ca:bc:23"/>
Apr 13 20:24:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:01 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:24:01 user nova-compute[71285]:       <target dev="tap4c29a89c-5e"/>
Apr 13 20:24:01 user nova-compute[71285]:     </interface>
Apr 13 20:24:01 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:24:01 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/console.log" append="off"/>
Apr 13 20:24:01 user nova-compute[71285]:     </serial>
Apr 13 20:24:01 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:24:01 user nova-compute[71285]:     <video>
Apr 13 20:24:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:01 user nova-compute[71285]:     </video>
Apr 13 20:24:01 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:24:01 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:24:01 user nova-compute[71285]:     </rng>
Apr 13 20:24:01 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:24:01 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:24:01 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:24:01 user nova-compute[71285]:     </memballoon>
Apr 13 20:24:01 user nova-compute[71285]:   </devices>
Apr 13 20:24:01 user nova-compute[71285]: </domain>
Apr 13 20:24:01 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1024576911',display_name='tempest-TestStampPattern-server-1024576911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1024576911',id=17,image_ref='0a3095d4-082a-4c70-84d0-8daaa3d5d513',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-w7m8f0lp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9e0bb04-2572-4973-af9c-a607ca0b170b',image_min_disk='1',image_min_ram='0',image_owner_id='d32350a5bf9a4d8b80c6bc1708387d1f',image_owner_project_name='tempest-TestStampPattern-1872935518',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1872935518-project-member',image_user_id='29ed39378db34acd835d13c0cacad399',network_allocated='True',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:57Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=5ae3eea8-5d28-46eb-8e84-86958032a048,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG os_vif [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c29a89c-5e, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c29a89c-5e, col_values=(('external_ids', {'iface-id': '4c29a89c-5e3a-42f4-a315-8c579dc498ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:bc:23', 'vm-uuid': '5ae3eea8-5d28-46eb-8e84-86958032a048'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: INFO os_vif [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e')
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No VIF found with MAC fa:16:3e:ca:bc:23, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:01 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Took 0.67 seconds to deallocate network for instance.
Apr 13 20:24:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-70c6fdac-f1f6-4a95-b0b3-35ea6dd4e539 req-da624f8e-5ec7-454c-8896-8ae6dd0c9aba service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-deleted-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updated VIF entry in instance network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3a4bfa9-14f4-4683-ba8f-826c234510d3 req-2e76dd66-19f2-42b7-858e-05629b8fd673 service nova] Releasing lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.555s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:02 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Deleted allocations for instance 66835d12-d155-4684-a9f0-41587936af9f
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e5f08946-cc29-4b83-a23d-3fab68b9b535 tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "66835d12-d155-4684-a9f0-41587936af9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.559s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.compute.manager [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Acquiring lock "66835d12-d155-4684-a9f0-41587936af9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] Lock "66835d12-d155-4684-a9f0-41587936af9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.compute.manager [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] No waiting events found dispatching network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:02 user nova-compute[71285]: WARNING nova.compute.manager [req-f81aa68a-c8cd-48f2-a8d5-960a6947a852 req-35c7b0fc-4d0f-45fe-b632-57272720ec81 service nova] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Received unexpected event network-vif-plugged-96c19e26-cbdc-46a9-9a5c-59ce6d04e416 for instance with vm_state deleted and task_state None.
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:24:02 user nova-compute[71285]: INFO nova.compute.claims [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Claim successful on node user
Apr 13 20:24:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:24:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:24:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating image(s)
Apr 13 20:24:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:03 user nova-compute[71285]: DEBUG nova.policy [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.180s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk 1073741824" returned: 0 in 0.080s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Cannot resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'migration_context' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Ensure instance console log exists: /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] No waiting events found dispatching network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:04 user nova-compute[71285]: WARNING nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received unexpected event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance with vm_state building and task_state spawning.
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] No waiting events found dispatching network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:04 user nova-compute[71285]: WARNING nova.compute.manager [req-85bf1da6-5f21-45c1-8165-e3575f8bae65 req-c5e35bbf-684d-41d2-8552-39098a0aace7 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received unexpected event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance with vm_state building and task_state spawning.
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:24:05 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:24:05 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:24:05 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdcfff0-9caa-4586-a749-71be8f064611]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:24:05 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad1bb8-1924-4884-8564-f2f750463536]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e] added
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ff1bf6-4c1a-4049-88d4-fc7e50e6f99f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[887b8f0d-c614-4076-b306-b60e84ce0f79]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVxuXTeW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVxuXTeW" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41b9f44-922a-4508-a013-ba5cfda5454d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVxuXTeW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ce012-67d3-4173-b7e7-6e087a22bce1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18349650-1f4f-447d-b57f-f09084292a85]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411065a-30b9-4d61-8cf7-013f40c8e904]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]
Apr 13 20:24:05 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2beac7b-70ec-419a-bebc-024fa6616a3f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d273f1fc-f99d-4075-9806-9256bab40498]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:05 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:24:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.032s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5cdd4-dd0f-4332-b17a-c728a8145803]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Successfully created port: 2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417445.8500397, 5ae3eea8-5d28-46eb-8e84-86958032a048 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:05 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] VM Resumed (Lifecycle Event)
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:24:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Instance spawned successfully.
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:05 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417445.8512318, 5ae3eea8-5d28-46eb-8e84-86958032a048 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:05 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] VM Started (Lifecycle Event)
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:05 user nova-compute[71285]: INFO nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Took 8.40 seconds to spawn the instance on the hypervisor.
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:06 user nova-compute[71285]: INFO nova.compute.manager [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Took 9.37 seconds to build instance.
Apr 13 20:24:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-39bbb60c-f78d-422c-85c9-35b5ba3c1463 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.508s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26538376636376134', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538376636376134', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:24:06 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:24:06 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:24:06 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:24:06 user nova-compute[71285]:   <serial>6aa89e26-6353-427a-a9ef-10c96effef8e</serial>
Apr 13 20:24:06 user nova-compute[71285]: </disk>
Apr 13 20:24:06 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Successfully updated port: 2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-changed-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Refreshing instance network info cache due to event network-changed-2a0918fa-0318-4cee-aa86-e65201b06aa8. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:24:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance network_info: |[{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Refreshing network info cache for port 2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start _get_guest_xml network_info=[{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No VIF found with MAC fa:16:3e:b8:5a:71, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:24:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-80955434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:24:07 user nova-compute[71285]:   <uuid>b8bcf189-a781-474e-bc4f-8a471a661e93</uuid>
Apr 13 20:24:07 user nova-compute[71285]:   <name>instance-00000012</name>
Apr 13 20:24:07 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:24:07 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:24:07 user nova-compute[71285]:   <metadata>
Apr 13 20:24:07 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:24:07 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-80955434</nova:name>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:24:07</nova:creationTime>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:24:07 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:24:07 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:owner>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:24:07 user nova-compute[71285]:       </nova:owner>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:24:07 user nova-compute[71285]:       <nova:ports>
Apr 13 20:24:07 user nova-compute[71285]:         <nova:port uuid="2a0918fa-0318-4cee-aa86-e65201b06aa8">
Apr 13 20:24:07 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:24:07 user nova-compute[71285]:         </nova:port>
Apr 13 20:24:07 user nova-compute[71285]:       </nova:ports>
Apr 13 20:24:07 user nova-compute[71285]:     </nova:instance>
Apr 13 20:24:07 user nova-compute[71285]:   </metadata>
Apr 13 20:24:07 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:24:07 user nova-compute[71285]:     <system>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="serial">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="uuid">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:24:07 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:24:07 user nova-compute[71285]:     </system>
Apr 13 20:24:07 user nova-compute[71285]:   </sysinfo>
Apr 13 20:24:07 user nova-compute[71285]:   <os>
Apr 13 20:24:07 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:24:07 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:24:07 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:24:07 user nova-compute[71285]:   </os>
Apr 13 20:24:07 user nova-compute[71285]:   <features>
Apr 13 20:24:07 user nova-compute[71285]:     <acpi/>
Apr 13 20:24:07 user nova-compute[71285]:     <apic/>
Apr 13 20:24:07 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:24:07 user nova-compute[71285]:   </features>
Apr 13 20:24:07 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:24:07 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:24:07 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:24:07 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:24:07 user nova-compute[71285]:   </clock>
Apr 13 20:24:07 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:24:07 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:24:07 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:24:07 user nova-compute[71285]:   </cpu>
Apr 13 20:24:07 user nova-compute[71285]:   <devices>
Apr 13 20:24:07 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:24:07 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:24:07 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk"/>
Apr 13 20:24:07 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:24:07 user nova-compute[71285]:     </disk>
Apr 13 20:24:07 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:24:07 user nova-compute[71285]:       <mac address="fa:16:3e:a6:33:90"/>
Apr 13 20:24:07 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:07 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:24:07 user nova-compute[71285]:       <target dev="tap2a0918fa-03"/>
Apr 13 20:24:07 user nova-compute[71285]:     </interface>
Apr 13 20:24:07 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:24:07 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log" append="off"/>
Apr 13 20:24:07 user nova-compute[71285]:     </serial>
Apr 13 20:24:07 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:24:07 user nova-compute[71285]:     <video>
Apr 13 20:24:07 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:07 user nova-compute[71285]:     </video>
Apr 13 20:24:07 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:24:07 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:24:07 user nova-compute[71285]:     </rng>
Apr 13 20:24:07 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:24:07 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:24:07 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:24:07 user nova-compute[71285]:     </memballoon>
Apr 13 20:24:07 user nova-compute[71285]:   </devices>
Apr 13 20:24:07 user nova-compute[71285]: </domain>
Apr 13 20:24:07 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-80955434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:24:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG os_vif [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0918fa-03, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0918fa-03, col_values=(('external_ids', {'iface-id': '2a0918fa-0318-4cee-aa86-e65201b06aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:33:90', 'vm-uuid': 'b8bcf189-a781-474e-bc4f-8a471a661e93'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:07 user nova-compute[71285]: INFO os_vif [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:a6:33:90, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1f15f5f-6e0f-4f68-9baa-0ee8446e5342 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.931s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updated VIF entry in instance network info cache for port 2a0918fa-0318-4cee-aa86-e65201b06aa8. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-76a267ed-a7d9-407c-a5da-34043eeee2ec req-e260b2c1-da15-4888-bfea-1b0cfe2248c3 service nova] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71285) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:24:08 user nova-compute[71285]: INFO nova.compute.claims [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Claim successful on node user
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:08 user nova-compute[71285]: WARNING nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state active and task_state powering-off.
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:08 user nova-compute[71285]: WARNING nova.compute.manager [req-9c9b5b7f-a2f3-4b2a-a705-a904c1aa302f req-0232f4de-fb75-47bf-a902-f0dfc23064dc service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state active and task_state powering-off.
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance destroyed successfully.
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b55d9835-053b-4bc2-9de7-d5c267393020 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.361s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:24:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:09 user nova-compute[71285]: WARNING nova.compute.manager [req-e9646161-8fa2-43ec-b555-960eb1fe7f16 req-ea25c575-23d0-4f84-b8de-3ca339597bf8 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state building and task_state spawning.
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.policy [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:24:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Creating image(s)
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "/opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk 1073741824" returned: 0 in 0.052s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.203s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Cannot resize image /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'migration_context' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Ensure instance console log exists: /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:10 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Successfully created port: d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Successfully updated port: d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquired lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-changed-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Refreshing instance network info cache due to event network-changed-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Acquiring lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updating instance_info_cache with network_info: [{"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:11 user nova-compute[71285]: WARNING nova.compute.manager [req-eec6710b-442c-4de7-90b1-dc9f03299a83 req-813c2f7f-f553-4c47-9524-3731c7aa73e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state building and task_state spawning.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Releasing lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Instance network_info: |[{"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Acquired lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Refreshing network info cache for port d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Start _get_guest_xml network_info=[{"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:24:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073344445',display_name='tempest-AttachVolumeNegativeTest-server-2073344445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073344445',id=19,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdjoDiR1/sxa22KQXzCamjjsrRTyiAOJ2BXVbr3VKtptw//6iZxUKXiHIuassm+TSllT76mN0mTCLuZjyyqQw92kfnNawKIbveVY+nl2cPGP5yLSaDV6Jq9V6tpSU1rkQ==',key_name='tempest-keypair-460582492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-rhn0f1tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=a369e185-3d75-4dde-8e8a-0e397aab892b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'pci_devices' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417451.49392, b8bcf189-a781-474e-bc4f-8a471a661e93 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Resumed (Lifecycle Event)
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:24:11 user nova-compute[71285]:   <uuid>a369e185-3d75-4dde-8e8a-0e397aab892b</uuid>
Apr 13 20:24:11 user nova-compute[71285]:   <name>instance-00000013</name>
Apr 13 20:24:11 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:24:11 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:24:11 user nova-compute[71285]:   <metadata>
Apr 13 20:24:11 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:24:11 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2073344445</nova:name>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:24:11</nova:creationTime>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:24:11 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:24:11 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:owner>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:user uuid="49383d6f0e7141548370d8bc3b96dfd9">tempest-AttachVolumeNegativeTest-1371087403-project-member</nova:user>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:project uuid="053f656470d94d2a9140f393bad01000">tempest-AttachVolumeNegativeTest-1371087403</nova:project>
Apr 13 20:24:11 user nova-compute[71285]:       </nova:owner>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:24:11 user nova-compute[71285]:       <nova:ports>
Apr 13 20:24:11 user nova-compute[71285]:         <nova:port uuid="d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d">
Apr 13 20:24:11 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 20:24:11 user nova-compute[71285]:         </nova:port>
Apr 13 20:24:11 user nova-compute[71285]:       </nova:ports>
Apr 13 20:24:11 user nova-compute[71285]:     </nova:instance>
Apr 13 20:24:11 user nova-compute[71285]:   </metadata>
Apr 13 20:24:11 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:24:11 user nova-compute[71285]:     <system>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="serial">a369e185-3d75-4dde-8e8a-0e397aab892b</entry>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="uuid">a369e185-3d75-4dde-8e8a-0e397aab892b</entry>
Apr 13 20:24:11 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:24:11 user nova-compute[71285]:     </system>
Apr 13 20:24:11 user nova-compute[71285]:   </sysinfo>
Apr 13 20:24:11 user nova-compute[71285]:   <os>
Apr 13 20:24:11 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:24:11 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:24:11 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:24:11 user nova-compute[71285]:   </os>
Apr 13 20:24:11 user nova-compute[71285]:   <features>
Apr 13 20:24:11 user nova-compute[71285]:     <acpi/>
Apr 13 20:24:11 user nova-compute[71285]:     <apic/>
Apr 13 20:24:11 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:24:11 user nova-compute[71285]:   </features>
Apr 13 20:24:11 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:24:11 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:24:11 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:24:11 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:24:11 user nova-compute[71285]:   </clock>
Apr 13 20:24:11 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:24:11 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:24:11 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:24:11 user nova-compute[71285]:   </cpu>
Apr 13 20:24:11 user nova-compute[71285]:   <devices>
Apr 13 20:24:11 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:24:11 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:24:11 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk"/>
Apr 13 20:24:11 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:24:11 user nova-compute[71285]:     </disk>
Apr 13 20:24:11 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:24:11 user nova-compute[71285]:       <mac address="fa:16:3e:b1:5c:98"/>
Apr 13 20:24:11 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:11 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:24:11 user nova-compute[71285]:       <target dev="tapd1c8d9d1-ab"/>
Apr 13 20:24:11 user nova-compute[71285]:     </interface>
Apr 13 20:24:11 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:24:11 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/console.log" append="off"/>
Apr 13 20:24:11 user nova-compute[71285]:     </serial>
Apr 13 20:24:11 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:24:11 user nova-compute[71285]:     <video>
Apr 13 20:24:11 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:24:11 user nova-compute[71285]:     </video>
Apr 13 20:24:11 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:24:11 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:24:11 user nova-compute[71285]:     </rng>
Apr 13 20:24:11 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:24:11 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:24:11 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:24:11 user nova-compute[71285]:     </memballoon>
Apr 13 20:24:11 user nova-compute[71285]:   </devices>
Apr 13 20:24:11 user nova-compute[71285]: </domain>
Apr 13 20:24:11 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073344445',display_name='tempest-AttachVolumeNegativeTest-server-2073344445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073344445',id=19,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdjoDiR1/sxa22KQXzCamjjsrRTyiAOJ2BXVbr3VKtptw//6iZxUKXiHIuassm+TSllT76mN0mTCLuZjyyqQw92kfnNawKIbveVY+nl2cPGP5yLSaDV6Jq9V6tpSU1rkQ==',key_name='tempest-keypair-460582492',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-rhn0f1tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=a369e185-3d75-4dde-8e8a-0e397aab892b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG os_vif [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1c8d9d1-ab, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd1c8d9d1-ab, col_values=(('external_ids', {'iface-id': 'd1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:5c:98', 'vm-uuid': 'a369e185-3d75-4dde-8e8a-0e397aab892b'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance spawned successfully.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:11 user nova-compute[71285]: INFO os_vif [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab')
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417451.4942734, b8bcf189-a781-474e-bc4f-8a471a661e93 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Started (Lifecycle Event)
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:b1:5c:98, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Took 7.88 seconds to spawn the instance on the hypervisor.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:11 user nova-compute[71285]: INFO nova.compute.manager [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Took 8.85 seconds to build instance.
Apr 13 20:24:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2932ff2c-d0df-4791-a986-5a472177bbcf tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.961s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:12 user nova-compute[71285]: DEBUG nova.network.neutron [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updated VIF entry in instance network info cache for port d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:24:12 user nova-compute[71285]: DEBUG nova.network.neutron [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updating instance_info_cache with network_info: [{"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-31bdc514-b5eb-434b-a10e-afe9f5fd0e32 req-c78f878b-f638-4c04-8f70-b826dccc6e55 service nova] Releasing lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] No waiting events found dispatching network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:13 user nova-compute[71285]: WARNING nova.compute.manager [req-cbe69d71-e055-4fc3-89c5-5b3c15d09385 req-58b64413-c43b-4425-877e-23ca0b989480 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received unexpected event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance with vm_state building and task_state spawning.
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417455.4506445, a369e185-3d75-4dde-8e8a-0e397aab892b => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] VM Resumed (Lifecycle Event)
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Instance spawned successfully.
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417455.4520824, a369e185-3d75-4dde-8e8a-0e397aab892b => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] VM Started (Lifecycle Event)
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Took 6.10 seconds to spawn the instance on the hypervisor.
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Took 7.09 seconds to build instance.
Apr 13 20:24:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0859ede9-693e-4d16-8dfc-a7655efd4503 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.192s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] No waiting events found dispatching network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:15 user nova-compute[71285]: WARNING nova.compute.manager [req-540bacd9-8b40-4105-8b9b-eb468bfaea49 req-5d9d4260-3399-4f9c-bdaa-0ff2f3581fc9 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received unexpected event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance with vm_state active and task_state None.
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417440.9322116, 66835d12-d155-4684-a9f0-41587936af9f => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:15 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 66835d12-d155-4684-a9f0-41587936af9f] VM Stopped (Lifecycle Event)
Apr 13 20:24:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-de9c710c-e4c8-46d7-931e-9e4d51368347 None None] [instance: 66835d12-d155-4684-a9f0-41587936af9f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:24 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417449.0614197, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:24 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Stopped (Lifecycle Event)
Apr 13 20:24:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-18df579c-12e3-42e7-b219-e566d3f9d185 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-18df579c-12e3-42e7-b219-e566d3f9d185 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:35 user nova-compute[71285]: INFO nova.compute.manager [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Detaching volume 1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c
Apr 13 20:24:35 user nova-compute[71285]: INFO nova.virt.block_device [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Attempting to driver detach volume 1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c from mountpoint /dev/vdc
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Attempting to detach device vdc from instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:24:35 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:24:35 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:24:35 user nova-compute[71285]:   <target dev="vdc" bus="virtio"/>
Apr 13 20:24:35 user nova-compute[71285]:   <serial>1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c</serial>
Apr 13 20:24:35 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:24:35 user nova-compute[71285]: </disk>
Apr 13 20:24:35 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:24:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully detached device vdc from instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 from the persistent domain config.
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:24:35 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:24:35 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:24:35 user nova-compute[71285]:   <target dev="vdc" bus="virtio"/>
Apr 13 20:24:35 user nova-compute[71285]:   <serial>1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c</serial>
Apr 13 20:24:35 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:24:35 user nova-compute[71285]: </disk>
Apr 13 20:24:35 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417475.6790774, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:24:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully detached device vdc from instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 from the live domain config.
Apr 13 20:24:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaYmVwEH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:24:35 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f920374-3547-4fff-b876-de0919d9bb44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:24:35 user nova-compute[71285]: No targets found.
Apr 13 20:24:35 user nova-compute[71285]: iSNS:
Apr 13 20:24:35 user nova-compute[71285]: No targets found.
Apr 13 20:24:35 user nova-compute[71285]: STATIC:
Apr 13 20:24:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c
Apr 13 20:24:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:24:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:24:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:24:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:24:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:24:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb
Apr 13 20:24:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:24:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:24:35 user nova-compute[71285]: FIRMWARE:
Apr 13 20:24:35 user nova-compute[71285]: No targets found.
Apr 13 20:24:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:24:35 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:24:35 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be4664-5645-41ee-a9b3-7b68180da4ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93231efc-dcc7-4d93-b639-6cad2ff16a15]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:35 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:35 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:24:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:24:35 user nova-compute[71285]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c (non-flash)
Apr 13 20:24:35 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:24:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6473e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79f7e3-6e70-4ab3-85af-10ff20b2a4eb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c3f743-c3b9-4285-a1d9-5732ccbfabb4]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61968ec6-153d-432f-8751-993fba7ed6cb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a433db2-230a-4843-9f44-bab1456cb2ef]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[438f5043-0482-40bb-8943-073cad2233d7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b183fa-d4bd-4db1-9371-876830293b30]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260]
Apr 13 20:24:35 user nova-compute[71285]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c, portal: 172.16.0.220,3260] successful.
Apr 13 20:24:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b11875f-fd23-48ff-8c5d-5e2ed3e79b2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80859e87-500e-4d1a-a508-eb89ce84d2b6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] <== disconnect_volume: return (308ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG nova.objects.instance [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'flavor' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-fd7309e7-8897-4998-8db3-3577ad0dcdf2 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:24:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:41 user nova-compute[71285]: INFO nova.compute.manager [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Unrescuing
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'flavor' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:41 user nova-compute[71285]: WARNING nova.compute.manager [req-8eeac86a-439a-4474-8b52-e8018d7abeda req-fbb6aa35-8be1-491a-950f-8115068fe2d7 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing instance network info cache due to event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:24:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance destroyed successfully.
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated VIF entry in instance network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cf9dc960-57a2-44d1-addc-4d266d054cbb req-e9e1eb69-7c2b-4609-9edc-51d91395419d service nova] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:44 user nova-compute[71285]: WARNING nova.compute.manager [req-af215836-1af8-4d44-ac92-e478b97ec302 req-9db84b07-fbc6-4498-89c6-fed504601939 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing instance network info cache due to event network-changed-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Acquiring lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Acquired lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Refreshing network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updated VIF entry in instance network info cache for port 55d65e58-cf52-4044-a5c3-b7d5c4bf4bad. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [{"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-93844458-db57-48d1-b2fc-09940c23f986 req-052fb29e-c4a6-4595-b966-3eb66747ab65 service nova] Releasing lock "refresh_cache-54d25a51-cd3f-4ea1-9de4-66de37fcb476" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:24:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 54d25a51-cd3f-4ea1-9de4-66de37fcb476 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417486.0854712, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Resumed (Lifecycle Event)
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2f1f7c17-1b95-40c1-9c01-9cd10ef75cd7 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:46 user nova-compute[71285]: WARNING nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:46 user nova-compute[71285]: WARNING nova.compute.manager [req-e592a4ea-5795-49f7-95e5-85a90a6a56eb req-3d5e0fdf-16de-4d3f-aa99-167cfb674d63 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417486.098689, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:24:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Started (Lifecycle Event)
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:24:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:24:48 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:48 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7571MB free_disk=26.304676055908203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0136288f-abaf-4a7c-a878-db415ff98f4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a369e185-3d75-4dde-8e8a-0e397aab892b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:24:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:24:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:24:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [{"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:24:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:24:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:53 user nova-compute[71285]: INFO nova.compute.manager [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Terminating instance
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-unplugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] No waiting events found dispatching network-vif-unplugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-e49d146d-d672-4d4a-864b-c1edea981108 req-730b4f9e-f73d-461e-ac07-077f44342516 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-unplugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Instance destroyed successfully.
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lazy-loading 'resources' on Instance uuid 0136288f-abaf-4a7c-a878-db415ff98f4b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1689071346',display_name='tempest-VolumesAdminNegativeTest-server-1689071346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1689071346',id=4,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMR5psfAcnJlKjT/RtzaTkF3/qOYyDj5Xn6kIK/NUuAwGleXA15sRvKayZlO18tYgwanamPIT8ZggDbnda9sBlIc1tFLCti7muSZvOgdDdZfdJxmASXXhL821fWkXkfIg==',key_name='tempest-keypair-2052829447',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41ed651e141447b995ccae680f1f3681',ramdisk_id='',reservation_id='r-voi0okh3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1573778134',owner_user_name='tempest-VolumesAdminNegativeTest-1573778134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cbfa14567af452db21cb0022514773b',uuid=0136288f-abaf-4a7c-a878-db415ff98f4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:24:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converting VIF {"id": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "address": "fa:16:3e:9b:45:0e", "network": {"id": "0307f481-3bd2-4735-bebd-a8e4fe253c1e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-133228376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41ed651e141447b995ccae680f1f3681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11b35baa-5e", "ovs_interfaceid": "11b35baa-5ecc-4d79-ba64-fd5ab401d2b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG os_vif [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11b35baa-5e, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:24:54 user nova-compute[71285]: INFO os_vif [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:45:0e,bridge_name='br-int',has_traffic_filtering=True,id=11b35baa-5ecc-4d79-ba64-fd5ab401d2b1,network=Network(0307f481-3bd2-4735-bebd-a8e4fe253c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11b35baa-5e')
Apr 13 20:24:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Deleting instance files /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b_del
Apr 13 20:24:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Deletion of /opt/stack/data/nova/instances/0136288f-abaf-4a7c-a878-db415ff98f4b_del complete
Apr 13 20:24:54 user nova-compute[71285]: INFO nova.compute.manager [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 20:24:54 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:24:54 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Took 0.82 seconds to deallocate network for instance.
Apr 13 20:24:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-ba458b3d-03f1-4ba1-991d-77143553909c req-d5759481-2847-4761-a7df-53bc9370ef32 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-deleted-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:55 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Deleted allocations for instance 0136288f-abaf-4a7c-a878-db415ff98f4b
Apr 13 20:24:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1296853-1b9e-4aad-980d-52035e793c3f tempest-VolumesAdminNegativeTest-1573778134 tempest-VolumesAdminNegativeTest-1573778134-project-member] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Acquiring lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] Lock "0136288f-abaf-4a7c-a878-db415ff98f4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:24:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] No waiting events found dispatching network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:24:55 user nova-compute[71285]: WARNING nova.compute.manager [req-d50784b0-61b6-4d73-a42b-268d1b638283 req-3a238d12-4461-4419-ab9b-0f83d3c54e74 service nova] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Received unexpected event network-vif-plugged-11b35baa-5ecc-4d79-ba64-fd5ab401d2b1 for instance with vm_state deleted and task_state None.
Apr 13 20:24:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:25:07 user nova-compute[71285]: INFO nova.compute.claims [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Claim successful on node user
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:25:07 user nova-compute[71285]: WARNING nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 57c6121a-c1be-467c-888f-1c42b03f95cf {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 31f49fca-6bb7-4297-b903-4c4ddbe325cf {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "65b84d48-a188-45d4-8720-4036faeaca58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:25:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:25:07 user nova-compute[71285]: WARNING oslo_messaging._drivers.amqpdriver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "65b84d48-a188-45d4-8720-4036faeaca58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.policy [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e39152c6dfed4218aa473532c49844ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '376fa6e005894aee80e4398704d956a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:25:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Creating image(s)
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "/opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "/opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "/opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk 1073741824" returned: 0 in 0.052s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Successfully created port: 27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Cannot resize image /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'migration_context' on Instance uuid 31f49fca-6bb7-4297-b903-4c4ddbe325cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Ensure instance console log exists: /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417493.9699326, 0136288f-abaf-4a7c-a878-db415ff98f4b => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:08 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] VM Stopped (Lifecycle Event)
Apr 13 20:25:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-bfe35840-3e64-413b-bcbf-3262d925d3b2 None None] [instance: 0136288f-abaf-4a7c-a878-db415ff98f4b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Successfully updated port: 27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquired lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-changed-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Refreshing instance network info cache due to event network-changed-27e6da64-070b-4a09-8874-138a9490d844. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Acquiring lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Updating instance_info_cache with network_info: [{"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Releasing lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Instance network_info: |[{"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Acquired lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Refreshing network info cache for port 27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Start _get_guest_xml network_info=[{"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:25:09 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:09 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1606749477',display_name='tempest-ServersNegativeTestJSON-server-1606749477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1606749477',id=20,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-mha7gvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:25:08Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=31f49fca-6bb7-4297-b903-4c4ddbe325cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.objects.instance [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'pci_devices' on Instance uuid 31f49fca-6bb7-4297-b903-4c4ddbe325cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:25:09 user nova-compute[71285]:   <uuid>31f49fca-6bb7-4297-b903-4c4ddbe325cf</uuid>
Apr 13 20:25:09 user nova-compute[71285]:   <name>instance-00000014</name>
Apr 13 20:25:09 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:25:09 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:25:09 user nova-compute[71285]:   <metadata>
Apr 13 20:25:09 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:25:09 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:name>tempest-ServersNegativeTestJSON-server-1606749477</nova:name>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:25:09</nova:creationTime>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:25:09 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:25:09 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:owner>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:user uuid="e39152c6dfed4218aa473532c49844ff">tempest-ServersNegativeTestJSON-1377252178-project-member</nova:user>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:project uuid="376fa6e005894aee80e4398704d956a7">tempest-ServersNegativeTestJSON-1377252178</nova:project>
Apr 13 20:25:09 user nova-compute[71285]:       </nova:owner>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:25:09 user nova-compute[71285]:       <nova:ports>
Apr 13 20:25:09 user nova-compute[71285]:         <nova:port uuid="27e6da64-070b-4a09-8874-138a9490d844">
Apr 13 20:25:09 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:25:09 user nova-compute[71285]:         </nova:port>
Apr 13 20:25:09 user nova-compute[71285]:       </nova:ports>
Apr 13 20:25:09 user nova-compute[71285]:     </nova:instance>
Apr 13 20:25:09 user nova-compute[71285]:   </metadata>
Apr 13 20:25:09 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:25:09 user nova-compute[71285]:     <system>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="serial">31f49fca-6bb7-4297-b903-4c4ddbe325cf</entry>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="uuid">31f49fca-6bb7-4297-b903-4c4ddbe325cf</entry>
Apr 13 20:25:09 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:25:09 user nova-compute[71285]:     </system>
Apr 13 20:25:09 user nova-compute[71285]:   </sysinfo>
Apr 13 20:25:09 user nova-compute[71285]:   <os>
Apr 13 20:25:09 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:25:09 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:25:09 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:25:09 user nova-compute[71285]:   </os>
Apr 13 20:25:09 user nova-compute[71285]:   <features>
Apr 13 20:25:09 user nova-compute[71285]:     <acpi/>
Apr 13 20:25:09 user nova-compute[71285]:     <apic/>
Apr 13 20:25:09 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:25:09 user nova-compute[71285]:   </features>
Apr 13 20:25:09 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:25:09 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:25:09 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:25:09 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:25:09 user nova-compute[71285]:   </clock>
Apr 13 20:25:09 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:25:09 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:25:09 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:25:09 user nova-compute[71285]:   </cpu>
Apr 13 20:25:09 user nova-compute[71285]:   <devices>
Apr 13 20:25:09 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:25:09 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:25:09 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk"/>
Apr 13 20:25:09 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:25:09 user nova-compute[71285]:     </disk>
Apr 13 20:25:09 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:25:09 user nova-compute[71285]:       <mac address="fa:16:3e:c9:7c:7d"/>
Apr 13 20:25:09 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:25:09 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:25:09 user nova-compute[71285]:       <target dev="tap27e6da64-07"/>
Apr 13 20:25:09 user nova-compute[71285]:     </interface>
Apr 13 20:25:09 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:25:09 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/console.log" append="off"/>
Apr 13 20:25:09 user nova-compute[71285]:     </serial>
Apr 13 20:25:09 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:25:09 user nova-compute[71285]:     <video>
Apr 13 20:25:09 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:25:09 user nova-compute[71285]:     </video>
Apr 13 20:25:09 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:25:09 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:25:09 user nova-compute[71285]:     </rng>
Apr 13 20:25:09 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:25:09 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:25:09 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:25:09 user nova-compute[71285]:     </memballoon>
Apr 13 20:25:09 user nova-compute[71285]:   </devices>
Apr 13 20:25:09 user nova-compute[71285]: </domain>
Apr 13 20:25:09 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1606749477',display_name='tempest-ServersNegativeTestJSON-server-1606749477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1606749477',id=20,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-mha7gvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:25:08Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=31f49fca-6bb7-4297-b903-4c4ddbe325cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG os_vif [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27e6da64-07, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27e6da64-07, col_values=(('external_ids', {'iface-id': '27e6da64-070b-4a09-8874-138a9490d844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:7c:7d', 'vm-uuid': '31f49fca-6bb7-4297-b903-4c4ddbe325cf'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:09 user nova-compute[71285]: INFO os_vif [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07')
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:25:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] No VIF found with MAC fa:16:3e:c9:7c:7d, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:25:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Updated VIF entry in instance network info cache for port 27e6da64-070b-4a09-8874-138a9490d844. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:25:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Updating instance_info_cache with network_info: [{"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-874994e2-bfe6-413c-920e-6034790e5aab req-32bb02d5-2ea0-4a3b-a040-861c71faf6ec service nova] Releasing lock "refresh_cache-31f49fca-6bb7-4297-b903-4c4ddbe325cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] No waiting events found dispatching network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:11 user nova-compute[71285]: WARNING nova.compute.manager [req-21872558-703f-4cf0-bcdf-86891c834184 req-e9bdf8d8-edea-441c-a7cb-411efc4afe83 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received unexpected event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 for instance with vm_state building and task_state spawning.
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417513.2041075, 31f49fca-6bb7-4297-b903-4c4ddbe325cf => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] VM Resumed (Lifecycle Event)
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Instance spawned successfully.
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417513.2072861, 31f49fca-6bb7-4297-b903-4c4ddbe325cf => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] VM Started (Lifecycle Event)
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] No waiting events found dispatching network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:13 user nova-compute[71285]: WARNING nova.compute.manager [req-d83a610b-23db-4cb1-a04a-b751d12fe83d req-7a2dbc68-c2f1-4b89-a41c-e2640515339e service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received unexpected event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 for instance with vm_state building and task_state spawning.
Apr 13 20:25:13 user nova-compute[71285]: INFO nova.compute.manager [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Took 6.34 seconds to build instance.
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af6f695e-5a18-4b8e-ab42-43f572af3239 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.462s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.798s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:14 user nova-compute[71285]: INFO nova.compute.manager [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Detaching volume 73e8450f-52ed-4e90-83e8-1ba72b5e60cb
Apr 13 20:25:14 user nova-compute[71285]: INFO nova.virt.block_device [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Attempting to driver detach volume 73e8450f-52ed-4e90-83e8-1ba72b5e60cb from mountpoint /dev/vdb
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Attempting to detach device vdb from instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:25:14 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:25:14 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:25:14 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:25:14 user nova-compute[71285]:   <serial>73e8450f-52ed-4e90-83e8-1ba72b5e60cb</serial>
Apr 13 20:25:14 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:25:14 user nova-compute[71285]: </disk>
Apr 13 20:25:14 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:25:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Successfully detached device vdb from instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 from the persistent domain config.
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:25:14 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:25:14 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:25:14 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:25:14 user nova-compute[71285]:   <serial>73e8450f-52ed-4e90-83e8-1ba72b5e60cb</serial>
Apr 13 20:25:14 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:25:14 user nova-compute[71285]: </disk>
Apr 13 20:25:14 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417514.7934968, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:25:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Successfully detached device vdb from instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 from the live domain config.
Apr 13 20:25:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrlGRomW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:25:14 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6428c84f-3cbd-4dec-95e4-18dd6def85fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:25:14 user nova-compute[71285]: No targets found.
Apr 13 20:25:14 user nova-compute[71285]: iSNS:
Apr 13 20:25:14 user nova-compute[71285]: No targets found.
Apr 13 20:25:14 user nova-compute[71285]: STATIC:
Apr 13 20:25:14 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:25:14 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:25:14 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:25:14 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb
Apr 13 20:25:14 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:25:14 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:25:14 user nova-compute[71285]: FIRMWARE:
Apr 13 20:25:14 user nova-compute[71285]: No targets found.
Apr 13 20:25:14 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:25:14 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:25:14 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df53bd2-be4a-4bbe-88e5-4b191e9f82e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833124d-a532-44bb-804b-36ce84b85607]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:25:14 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:14 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb (non-flash)
Apr 13 20:25:14 user nova-compute[71285]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:14 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6e154d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c10e5ee-e5ca-4907-b00c-1b86e1393d69]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db455c30-dac7-4a68-92ed-df220c4ba5bb]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d191fb-9f80-471a-9145-b7332eb40d24]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b7ad8a-45ab-49f7-bd6b-f85e7e00012f]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:25:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee770b-281c-4ee9-9e6b-22fbad2b0c8f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd12bbd3-8703-4c11-ba01-cb86c5d433cb]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260]
Apr 13 20:25:15 user nova-compute[71285]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb, portal: 172.16.0.220,3260] successful.
Apr 13 20:25:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:73e8450f-52ed-4e90-83e8-1ba72b5e60cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d64735-be30-45d2-b8a7-25cbf0aa1c11]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] <== disconnect_volume: return (306ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'flavor' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-273ba4c7-699e-4346-8326-d438aa5dd854 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:25 user nova-compute[71285]: INFO nova.compute.manager [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Terminating instance
Apr 13 20:25:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-b4f744f7-f846-4e00-849e-a39ed79b5fd3 req-b66f4bc0-b9fe-4e19-9722-caafb4286ef7 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-unplugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:25:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Instance destroyed successfully.
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'resources' on Instance uuid 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:18:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2122692990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2122692990',id=3,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOQLEfnUAdwXiipQWQC6KVFeB1qTwUX2x1/w1l3Smwk+oocpgJJtYwCafCK7wWtX/jdQXFNg9495lZCIwIq0anujj/KJcgFvWh54vZk//EcBX7yDONmBSz2eGEsOBPB1w==',key_name='tempest-keypair-1146136459',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:23:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-fuz8iywp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:23:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "df3a82f9-8c19-424c-a1b3-3332149ac690", "address": "fa:16:3e:a6:7e:d3", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf3a82f9-8c", "ovs_interfaceid": "df3a82f9-8c19-424c-a1b3-3332149ac690", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG os_vif [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf3a82f9-8c, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:26 user nova-compute[71285]: INFO os_vif [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:7e:d3,bridge_name='br-int',has_traffic_filtering=True,id=df3a82f9-8c19-424c-a1b3-3332149ac690,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf3a82f9-8c')
Apr 13 20:25:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Deleting instance files /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9_del
Apr 13 20:25:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Deletion of /opt/stack/data/nova/instances/2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9_del complete
Apr 13 20:25:26 user nova-compute[71285]: INFO nova.compute.manager [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 20:25:26 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:25:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:27 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Took 0.82 seconds to deallocate network for instance.
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-7e37a8ed-e82d-4e1d-86cc-2b47d4ac54fc req-75ad3906-c19e-44b7-bc32-074d8e56b969 service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-deleted-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:27 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Deleted allocations for instance 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1713725d-fcdc-4119-b13a-5baa17b3ebce tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Acquiring lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] Lock "2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] No waiting events found dispatching network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:27 user nova-compute[71285]: WARNING nova.compute.manager [req-ba584a9a-da58-49ce-ad3a-b97e4a40719c req-0fb2fbef-451b-41b1-9b31-f156d52f429a service nova] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Received unexpected event network-vif-plugged-df3a82f9-8c19-424c-a1b3-3332149ac690 for instance with vm_state deleted and task_state None.
Apr 13 20:25:27 user nova-compute[71285]: INFO nova.compute.manager [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Rescuing
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:27 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance destroyed successfully.
Apr 13 20:25:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Attempting rescue
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:25:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Creating image(s)
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'trusted_certs' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue" returned: 0 in 0.047s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start _get_guest_xml network_info=[{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:3d:86:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'numa_topology' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:29 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'vcpu_model' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1131214979',display_name='tempest-ServerRescueNegativeTestJSON-server-1131214979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1131214979',id=16,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-hffpcayr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:48Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=65b84d48-a188-45d4-8720-4036faeaca58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:3d:86:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:3d:86:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:25:29 user nova-compute[71285]:   <uuid>65b84d48-a188-45d4-8720-4036faeaca58</uuid>
Apr 13 20:25:29 user nova-compute[71285]:   <name>instance-00000010</name>
Apr 13 20:25:29 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:25:29 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:25:29 user nova-compute[71285]:   <metadata>
Apr 13 20:25:29 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:25:29 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1131214979</nova:name>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:25:29</nova:creationTime>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:25:29 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:25:29 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:owner>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:25:29 user nova-compute[71285]:       </nova:owner>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:25:29 user nova-compute[71285]:       <nova:ports>
Apr 13 20:25:29 user nova-compute[71285]:         <nova:port uuid="ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9">
Apr 13 20:25:29 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:25:29 user nova-compute[71285]:         </nova:port>
Apr 13 20:25:29 user nova-compute[71285]:       </nova:ports>
Apr 13 20:25:29 user nova-compute[71285]:     </nova:instance>
Apr 13 20:25:29 user nova-compute[71285]:   </metadata>
Apr 13 20:25:29 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:25:29 user nova-compute[71285]:     <system>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="serial">65b84d48-a188-45d4-8720-4036faeaca58</entry>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="uuid">65b84d48-a188-45d4-8720-4036faeaca58</entry>
Apr 13 20:25:29 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:25:29 user nova-compute[71285]:     </system>
Apr 13 20:25:29 user nova-compute[71285]:   </sysinfo>
Apr 13 20:25:29 user nova-compute[71285]:   <os>
Apr 13 20:25:29 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:25:29 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:25:29 user nova-compute[71285]:   </os>
Apr 13 20:25:29 user nova-compute[71285]:   <features>
Apr 13 20:25:29 user nova-compute[71285]:     <acpi/>
Apr 13 20:25:29 user nova-compute[71285]:     <apic/>
Apr 13 20:25:29 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:25:29 user nova-compute[71285]:   </features>
Apr 13 20:25:29 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:25:29 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:25:29 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:25:29 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:25:29 user nova-compute[71285]:   </clock>
Apr 13 20:25:29 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:25:29 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:25:29 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:25:29 user nova-compute[71285]:   </cpu>
Apr 13 20:25:29 user nova-compute[71285]:   <devices>
Apr 13 20:25:29 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:25:29 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:25:29 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue"/>
Apr 13 20:25:29 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:25:29 user nova-compute[71285]:     </disk>
Apr 13 20:25:29 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:25:29 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:25:29 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk"/>
Apr 13 20:25:29 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:25:29 user nova-compute[71285]:     </disk>
Apr 13 20:25:29 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:25:29 user nova-compute[71285]:       <mac address="fa:16:3e:3d:86:d0"/>
Apr 13 20:25:29 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:25:29 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:25:29 user nova-compute[71285]:       <target dev="tapca4ebdd2-ce"/>
Apr 13 20:25:29 user nova-compute[71285]:     </interface>
Apr 13 20:25:29 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:25:29 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/console.log" append="off"/>
Apr 13 20:25:29 user nova-compute[71285]:     </serial>
Apr 13 20:25:29 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:25:29 user nova-compute[71285]:     <video>
Apr 13 20:25:29 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:25:29 user nova-compute[71285]:     </video>
Apr 13 20:25:29 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:25:29 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:25:29 user nova-compute[71285]:     </rng>
Apr 13 20:25:29 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:25:29 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:25:29 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:25:29 user nova-compute[71285]:     </memballoon>
Apr 13 20:25:29 user nova-compute[71285]:   </devices>
Apr 13 20:25:29 user nova-compute[71285]: </domain>
Apr 13 20:25:29 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:25:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance destroyed successfully.
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:3d:86:d0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:29 user nova-compute[71285]: WARNING nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state active and task_state rescuing.
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:29 user nova-compute[71285]: WARNING nova.compute.manager [req-5a8d02fe-7a5f-465c-8e47-d3a08b12f81a req-9184dea1-2978-48bd-a156-ad3b2f9ec4cf service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state active and task_state rescuing.
Apr 13 20:25:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:32 user nova-compute[71285]: WARNING nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state active and task_state rescuing.
Apr 13 20:25:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:25:32 user nova-compute[71285]: WARNING nova.compute.manager [req-83e6ea24-c54b-4bab-b66a-a9f2adbd08f4 req-6096afae-79f0-4475-a31a-0d5d3eca8aef service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state active and task_state rescuing.
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 65b84d48-a188-45d4-8720-4036faeaca58 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417533.0331237, 65b84d48-a188-45d4-8720-4036faeaca58 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:33 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] VM Resumed (Lifecycle Event)
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c00b060f-2ca3-4fd9-8825-f2864d042a62 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:25:33 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417533.03768, 65b84d48-a188-45d4-8720-4036faeaca58 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:33 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] VM Started (Lifecycle Event)
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:25:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:41 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417526.3617008, 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:25:41 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] VM Stopped (Lifecycle Event)
Apr 13 20:25:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1eb05e9f-d027-4da3-a34f-bcecae3729bb None None] [instance: 2d728b0f-1ee1-48bd-9aa8-3a3d25ae2fc9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:25:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:42 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing instance network info cache due to event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Acquiring lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Acquired lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG nova.objects.instance [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.118s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=26.30264663696289GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:49 user nova-compute[71285]: INFO nova.compute.manager [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Attaching volume e0db1430-89ec-4825-927c-9462b4963a26 to /dev/vdb
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.network.neutron [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updated VIF entry in instance network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.network.neutron [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.utils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab4b4a85-7644-4a04-ba93-0871590a0bc6 req-cb987416-f6cf-4594-885b-d40fe49145aa service nova] Releasing lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f948f11-167f-4c20-85b7-a00335b896b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a369e185-3d75-4dde-8e8a-0e397aab892b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e7084c-e2c4-47f0-9205-e0e8c64a4f42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ff409-ab34-4894-9ebf-8cf14a1c2ba6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3528405a-b2e2-4047-81d9-8fdf12d3fa7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:25:49 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c793f-ee39-4666-a7c5-2c22d52b2125]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG os_brick.utils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating existing volume attachment record: 64cd186b-cd2b-43bd-8587-1b344d3994fe {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:25:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-changed-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:25:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Refreshing instance network info cache due to event network-changed-2a0918fa-0318-4cee-aa86-e65201b06aa8. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:25:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Refreshing network info cache for port 2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApDcjSft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:25:54 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:25:54 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:25:54 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[418748b8-783f-4112-80b6-0112cb836961]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:25:54 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updated VIF entry in instance network info cache for port 2a0918fa-0318-4cee-aa86-e65201b06aa8. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1e325-3d05-4025-9178-c3f65e969da0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26] added
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10cfd815-5934-447a-8b77-517833e7060f req-8c6d5047-3d72-4e7b-9237-7d5594abae76 service nova] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22900a6e-d0de-4158-9c13-f9402ab4e832]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d702bddc-fe42-46b1-9e92-628d4aade437]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApDcjSft {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ApDcjSft" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2b7df0-3872-4ec4-b9cd-bad2e29b99a3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ApDcjSft'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef683f-8964-4312-ace7-68bd0b95262d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed3b3b-6df1-4632-8cbb-dcd9c4a7bb23]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e119ec-1b08-4b47-bc1f-c15b15a8ce3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260]
Apr 13 20:25:54 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260] successful.
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02afc53f-0721-4679-9dab-813da2129d56]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fee773-a12f-48e7-892e-001fbf9807a6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:54 user nova-compute[71285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:54 user nova-compute[71285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)
Apr 13 20:25:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf65bc7-25f6-46ff-b02e-46037ee323a3]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:25:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApDcjSft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23037623665343730', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037623665343730', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:25:55 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:25:55 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:25:55 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:25:55 user nova-compute[71285]:   <serial>e0db1430-89ec-4825-927c-9462b4963a26</serial>
Apr 13 20:25:55 user nova-compute[71285]: </disk>
Apr 13 20:25:55 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:25:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] No VIF found with MAC fa:16:3e:ca:bc:23, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:25:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f0756cef-55fa-4ea0-8522-6e8e0096e815 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.714s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:25:57 user nova-compute[71285]: INFO nova.compute.manager [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Detaching volume e0db1430-89ec-4825-927c-9462b4963a26
Apr 13 20:25:57 user nova-compute[71285]: INFO nova.virt.block_device [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Attempting to driver detach volume e0db1430-89ec-4825-927c-9462b4963a26 from mountpoint /dev/vdb
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Attempting to detach device vdb from instance 5ae3eea8-5d28-46eb-8e84-86958032a048 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:25:57 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:25:57 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:25:57 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:25:57 user nova-compute[71285]:   <serial>e0db1430-89ec-4825-927c-9462b4963a26</serial>
Apr 13 20:25:57 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:25:57 user nova-compute[71285]: </disk>
Apr 13 20:25:57 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:25:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully detached device vdb from instance 5ae3eea8-5d28-46eb-8e84-86958032a048 from the persistent domain config.
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ae3eea8-5d28-46eb-8e84-86958032a048 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:25:57 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:25:57 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:25:57 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:25:57 user nova-compute[71285]:   <serial>e0db1430-89ec-4825-927c-9462b4963a26</serial>
Apr 13 20:25:57 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:25:57 user nova-compute[71285]: </disk>
Apr 13 20:25:57 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417557.699221, 5ae3eea8-5d28-46eb-8e84-86958032a048 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:25:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully detached device vdb from instance 5ae3eea8-5d28-46eb-8e84-86958032a048 from the live domain config.
Apr 13 20:25:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ApDcjSft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:25:57 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7e82b9-5c2c-480b-9e7f-e393a1f8a630]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:25:57 user nova-compute[71285]: No targets found.
Apr 13 20:25:57 user nova-compute[71285]: iSNS:
Apr 13 20:25:57 user nova-compute[71285]: No targets found.
Apr 13 20:25:57 user nova-compute[71285]: STATIC:
Apr 13 20:25:57 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:25:57 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:25:57 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:25:57 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26
Apr 13 20:25:57 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:25:57 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:25:57 user nova-compute[71285]: FIRMWARE:
Apr 13 20:25:57 user nova-compute[71285]: No targets found.
Apr 13 20:25:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:25:57 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:25:57 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c9c10-b124-44e5-aac3-f3151eeeb07c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[691186b2-11e4-48f2-ac83-327cdaafc646]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:57 user nova-compute[71285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)
Apr 13 20:25:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:57 user nova-compute[71285]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 (non-flash)
Apr 13 20:25:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a76e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae4617-b882-4f3f-8f5a-7056ee42d3e4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4405a78-9a4f-4038-8e6a-7f39456d5e4b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1f6d38-2f7b-4f00-a046-26a5e572f123]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ebe1b8-75c9-453a-8519-699adba76055]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bfcf5c-f6cd-4e4a-b527-367c2852561f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e87aa-b52e-4f1b-a65f-a6bfba951957]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260]
Apr 13 20:25:57 user nova-compute[71285]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26, portal: 172.16.0.220,3260] successful.
Apr 13 20:25:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0db1430-89ec-4825-927c-9462b4963a26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c5fc4-099d-4991-9d91-a7dcbee88195]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] <== disconnect_volume: return (303ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'info_cache' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'flavor' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5643b45d-537c-45dd-9a26-2e32e6972355 tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.647s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:25:59 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance destroyed successfully.
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'resources' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5b9a9b4-bd, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:25:59 user nova-compute[71285]: INFO os_vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:25:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:25:59 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf6b9ab-6d62-41d0-9cb6-27485484b497]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:25:59 user nova-compute[71285]: No targets found.
Apr 13 20:25:59 user nova-compute[71285]: iSNS:
Apr 13 20:25:59 user nova-compute[71285]: No targets found.
Apr 13 20:25:59 user nova-compute[71285]: STATIC:
Apr 13 20:25:59 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:25:59 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:25:59 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:25:59 user nova-compute[71285]: FIRMWARE:
Apr 13 20:25:59 user nova-compute[71285]: No targets found.
Apr 13 20:25:59 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:25:59 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:25:59 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f8b59b-4610-4599-a2e5-13732b48722e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[679fbfae-52f1-40b6-a5a1-0386f2e52f3d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:59 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:25:59 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc643e9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d88f61-8326-40f4-a07c-86208339c895]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[133b60f7-23e0-4787-b588-b6bd69ec648d]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[425040e9-be23-4ad1-bb25-13290c222698]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:25:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[130da352-ab25-45e9-8931-7b2f68a54c94]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.compute.manager [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-changed-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.compute.manager [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Refreshing instance network info cache due to event network-changed-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Acquiring lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Acquired lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Refreshing network info cache for port d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a787b8b6-514c-4848-b023-5162273c5905]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34deb65-51bd-4636-b2e2-20fbfd91c4bd]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]
Apr 13 20:26:00 user nova-compute[71285]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.
Apr 13 20:26:00 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b2936-f4c1-4c2c-b08f-28dca87b29d6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== disconnect_volume: return (287ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start _get_guest_xml network_info=[{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '7d01394e-edb8-4c51-a71a-e07c0ee164db', 'attached_at': '', 'detached_at': '', 'volume_id': '6aa89e26-6353-427a-a9ef-10c96effef8e', 'serial': '6aa89e26-6353-427a-a9ef-10c96effef8e'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '168e6c19-050c-41ac-8725-dc276ae61f76', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:26:00 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:26:00 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:26:00 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f3939f-3dda-4840-9f1e-e5a3b0a45dff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:26:00 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a771f94b-2169-4ebc-b56f-199513944e6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e] added
Apr 13 20:26:00 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891a3ec-aad3-494d-8db4-f71459cb68dd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[30715bf1-88ad-4af5-805e-52bc6097bd3e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVxuXTeW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zVxuXTeW" returned: 0 in 0.181s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c51f5a2-5bba-4d9a-b248-6e6e53fbb790]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zVxuXTeW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[717c7e90-b909-4689-a847-53e2106bddb3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fc19dc-8b16-498b-8a46-88defd04f428]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:26:00 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:26:00 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:26:00 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:26:00 user nova-compute[71285]: 
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updated VIF entry in instance network info cache for port d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG nova.network.neutron [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updating instance_info_cache with network_info: [{"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-18842be3-3998-41fd-b42f-5b98b56dd7c8 req-ffb1db34-9ab9-419e-b760-2444d26eff84 service nova] Releasing lock "refresh_cache-a369e185-3d75-4dde-8e8a-0e397aab892b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94dbf39-9cd3-4ef1-b319-e2fbc08e04be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]
Apr 13 20:26:00 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.
Apr 13 20:26:00 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089c3f4-6061-4ba0-b6f1-28abed9ba8eb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fa5840-7a3a-4c0f-941d-de4c229bcad3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:00 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:00 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744f3e5-d4dd-48ec-9bf1-8e1f1f59ca6e]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:00 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26538376636376134', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538376636376134', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:26:01 user nova-compute[71285]:   <uuid>7d01394e-edb8-4c51-a71a-e07c0ee164db</uuid>
Apr 13 20:26:01 user nova-compute[71285]:   <name>instance-0000000c</name>
Apr 13 20:26:01 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:26:01 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:26:01 user nova-compute[71285]:   <metadata>
Apr 13 20:26:01 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:26:01 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeTestJSON-server-492449566</nova:name>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:26:00</nova:creationTime>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:26:01 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:26:01 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:owner>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:user uuid="b5210a73b1574e82838f3f0ccef93a25">tempest-AttachVolumeTestJSON-1545246928-project-member</nova:user>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:project uuid="587bca93ee3f45b9b5b1ceb91e972e7b">tempest-AttachVolumeTestJSON-1545246928</nova:project>
Apr 13 20:26:01 user nova-compute[71285]:       </nova:owner>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:26:01 user nova-compute[71285]:       <nova:ports>
Apr 13 20:26:01 user nova-compute[71285]:         <nova:port uuid="b5b9a9b4-bd38-4cfc-b483-9bae4721fb09">
Apr 13 20:26:01 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:26:01 user nova-compute[71285]:         </nova:port>
Apr 13 20:26:01 user nova-compute[71285]:       </nova:ports>
Apr 13 20:26:01 user nova-compute[71285]:     </nova:instance>
Apr 13 20:26:01 user nova-compute[71285]:   </metadata>
Apr 13 20:26:01 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:26:01 user nova-compute[71285]:     <system>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="serial">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="uuid">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:26:01 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:26:01 user nova-compute[71285]:     </system>
Apr 13 20:26:01 user nova-compute[71285]:   </sysinfo>
Apr 13 20:26:01 user nova-compute[71285]:   <os>
Apr 13 20:26:01 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:26:01 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:26:01 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:26:01 user nova-compute[71285]:   </os>
Apr 13 20:26:01 user nova-compute[71285]:   <features>
Apr 13 20:26:01 user nova-compute[71285]:     <acpi/>
Apr 13 20:26:01 user nova-compute[71285]:     <apic/>
Apr 13 20:26:01 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:26:01 user nova-compute[71285]:   </features>
Apr 13 20:26:01 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:26:01 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:26:01 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:26:01 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:26:01 user nova-compute[71285]:   </clock>
Apr 13 20:26:01 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:26:01 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:26:01 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:26:01 user nova-compute[71285]:   </cpu>
Apr 13 20:26:01 user nova-compute[71285]:   <devices>
Apr 13 20:26:01 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:26:01 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:26:01 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk"/>
Apr 13 20:26:01 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:26:01 user nova-compute[71285]:     </disk>
Apr 13 20:26:01 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:26:01 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:26:01 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:26:01 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:26:01 user nova-compute[71285]:       <serial>6aa89e26-6353-427a-a9ef-10c96effef8e</serial>
Apr 13 20:26:01 user nova-compute[71285]:     </disk>
Apr 13 20:26:01 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:26:01 user nova-compute[71285]:       <mac address="fa:16:3e:b8:5a:71"/>
Apr 13 20:26:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:01 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:26:01 user nova-compute[71285]:       <target dev="tapb5b9a9b4-bd"/>
Apr 13 20:26:01 user nova-compute[71285]:     </interface>
Apr 13 20:26:01 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:26:01 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/console.log" append="off"/>
Apr 13 20:26:01 user nova-compute[71285]:     </serial>
Apr 13 20:26:01 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:26:01 user nova-compute[71285]:     <video>
Apr 13 20:26:01 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:01 user nova-compute[71285]:     </video>
Apr 13 20:26:01 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:26:01 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:26:01 user nova-compute[71285]:     </rng>
Apr 13 20:26:01 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:26:01 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:26:01 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:26:01 user nova-compute[71285]:     </memballoon>
Apr 13 20:26:01 user nova-compute[71285]:   </devices>
Apr 13 20:26:01 user nova-compute[71285]: </domain>
Apr 13 20:26:01 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG nova.objects.instance [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:02 user nova-compute[71285]: INFO nova.compute.manager [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Attaching volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 to /dev/vdb
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.utils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f24484-5d12-4988-a9ef-333cd1a498ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec8c5a-c3f8-4fac-a031-2670bcd76c4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9aa8e5-86e1-4bd5-8594-5cb5c13e0419]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[99be1583-18c0-454a-b7cf-f11b7a49e619]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:26:02 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d24b40-747d-4c52-b8f5-f9ce835a81d9]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_brick.utils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updating existing volume attachment record: 7ec0adb7-0709-440d-a94b-cdce44330417 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Cannot resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'migration_context' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG os_vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5b9a9b4-bd, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5b9a9b4-bd, col_values=(('external_ids', {'iface-id': 'b5b9a9b4-bd38-4cfc-b483-9bae4721fb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5a:71', 'vm-uuid': '7d01394e-edb8-4c51-a71a-e07c0ee164db'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:02 user nova-compute[71285]: INFO os_vif [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:26:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:04 user nova-compute[71285]: WARNING nova.compute.manager [req-5c14b28c-35cd-41f6-add9-cb95d0d5f363 req-e700fbf1-96c3-45e2-af6b-142d39caa14d service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state stopped and task_state powering-on.
Apr 13 20:26:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:06 user nova-compute[71285]: WARNING nova.compute.manager [req-14d6534e-baf2-4e93-b0f9-634666e9014f req-6c802524-fb9f-4892-bd38-f6c459942b9c service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state stopped and task_state powering-on.
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417566.1276925, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Resumed (Lifecycle Event)
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:26:06 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance rebooted successfully.
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b92d4a88-11cd-4bf1-9f86-ac6ccbee52dc tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417566.1294668, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Started (Lifecycle Event)
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uteEqXsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:26:06 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:26:06 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:26:06 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[109769e6-28a9-4208-99e5-57c8c62ab99a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:26:06 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c58d6-be8a-4164-9ae6-a4f6dd4a4926]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959] added
Apr 13 20:26:06 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd0b6ba-5d0e-4613-9a17-fa9cbea227fb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[92502883-0b05-4f04-a0d5-62bad0ac2335]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uteEqXsw {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uteEqXsw" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b334ae2a-01ca-405d-8778-0b6506dfe41b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uteEqXsw'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4750ee46-fcb4-4a2b-a4ab-c7ea7b7d819c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df9b78-123b-4d3a-a164-f03e663eea83]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08985a5-2be3-4f34-aa1e-9dadeaa939ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260]
Apr 13 20:26:07 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260] successful.
Apr 13 20:26:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db800772-925a-4ed1-b52b-1625188eb8c8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e781c457-48d5-4a65-8581-07ac33bfd23e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:07 user nova-compute[71285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:26:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:26:07 user nova-compute[71285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:26:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da1b56d-bbfd-4e1a-83ae-a5a0fbfe93cd]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uteEqXsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:26:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:08 user nova-compute[71285]: INFO nova.compute.manager [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Terminating instance
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26161326530386262', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161326530386262', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:26:08 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:26:08 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:26:08 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:26:08 user nova-compute[71285]:   <serial>c609f609-6cab-47d1-85eb-bf8ad9a0a959</serial>
Apr 13 20:26:08 user nova-compute[71285]: </disk>
Apr 13 20:26:08 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-e5ac805f-bb8f-4a30-a58f-a600ff3d7d08 req-b62d75b7-6155-47df-824a-716aa9ed3752 service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-unplugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:b1:5c:98, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:26:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-cd3da186-6986-49d5-9925-966291c65d7f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.801s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Instance destroyed successfully.
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.objects.instance [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lazy-loading 'resources' on Instance uuid 54d25a51-cd3f-4ea1-9de4-66de37fcb476 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-348825334',display_name='tempest-ServerStableDeviceRescueTest-server-348825334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-348825334',id=1,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKq1U5QECB3FwD62l+VoD4RcrdT4EaNcIQSWZpqPdFG+5sUJl6aJ5L9iAijKA5SZiYUs+UXX2i0SuapMZsoqaM+jDDv+ifTc3jkJuvkYwnliPrzr/xR1kynUx8tBW306ag==',key_name='tempest-keypair-1968906009',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c3042be539b4749b37156c0e5a9d907',ramdisk_id='',reservation_id='r-pm90g9u5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1796731705',owner_user_name='tempest-ServerStableDeviceRescueTest-1796731705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:24:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cb2df6092c342e0b0f44c37abb4a88a',uuid=54d25a51-cd3f-4ea1-9de4-66de37fcb476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converting VIF {"id": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "address": "fa:16:3e:06:e5:44", "network": {"id": "9bff1def-38cf-4052-af77-c43c1b79af0a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-298744206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c3042be539b4749b37156c0e5a9d907", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55d65e58-cf", "ovs_interfaceid": "55d65e58-cf52-4044-a5c3-b7d5c4bf4bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG os_vif [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55d65e58-cf, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:09 user nova-compute[71285]: INFO os_vif [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:e5:44,bridge_name='br-int',has_traffic_filtering=True,id=55d65e58-cf52-4044-a5c3-b7d5c4bf4bad,network=Network(9bff1def-38cf-4052-af77-c43c1b79af0a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55d65e58-cf')
Apr 13 20:26:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Deleting instance files /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476_del
Apr 13 20:26:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Deletion of /opt/stack/data/nova/instances/54d25a51-cd3f-4ea1-9de4-66de37fcb476_del complete
Apr 13 20:26:09 user nova-compute[71285]: INFO nova.compute.manager [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 13 20:26:09 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:26:09 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:09 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Took 0.77 seconds to deallocate network for instance.
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:10 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Deleted allocations for instance 54d25a51-cd3f-4ea1-9de4-66de37fcb476
Apr 13 20:26:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Acquiring lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] No waiting events found dispatching network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:10 user nova-compute[71285]: WARNING nova.compute.manager [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received unexpected event network-vif-plugged-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad for instance with vm_state deleted and task_state None.
Apr 13 20:26:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-b2e55b85-de7a-40be-8202-89e655254ecf req-cd33bdb3-dffb-42ca-81bb-935bcbe5ec7d service nova] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Received event network-vif-deleted-55d65e58-cf52-4044-a5c3-b7d5c4bf4bad {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-93a27cc6-0246-4825-9b62-01aeeb02ce70 tempest-ServerStableDeviceRescueTest-1796731705 tempest-ServerStableDeviceRescueTest-1796731705-project-member] Lock "54d25a51-cd3f-4ea1-9de4-66de37fcb476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:12 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:26:12 user nova-compute[71285]: INFO nova.compute.claims [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Claim successful on node user
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:26:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.policy [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:26:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Creating image(s)
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "/opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk 1073741824" returned: 0 in 0.049s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:26:13 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Cannot resize image /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.objects.instance [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'migration_context' on Instance uuid 24a4358f-82a4-408d-8206-49f05579b45e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Successfully created port: f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Ensure instance console log exists: /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Successfully updated port: f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquired lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-changed-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Refreshing instance network info cache due to event network-changed-f0e44a58-4298-4a38-8717-df1a77e07a08. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Acquiring lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updating instance_info_cache with network_info: [{"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Releasing lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Instance network_info: |[{"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Acquired lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Refreshing network info cache for port f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Start _get_guest_xml network_info=[{"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:26:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890810329',display_name='tempest-AttachVolumeNegativeTest-server-890810329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890810329',id=21,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjITfErfI5lYMl/OBfOsCubod6xMYka7P1ow+hjTuaL7Z7vxoMaZ0i9tj7r9D26pmmekOuT/r6BdP2VqLpZ7VwGSf0pHHbaPbZEooTvFfELXkkm7TGz+xl7EPns2IjPgA==',key_name='tempest-keypair-1549482162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-x9aw405s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=24a4358f-82a4-408d-8206-49f05579b45e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'pci_devices' on Instance uuid 24a4358f-82a4-408d-8206-49f05579b45e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:26:15 user nova-compute[71285]:   <uuid>24a4358f-82a4-408d-8206-49f05579b45e</uuid>
Apr 13 20:26:15 user nova-compute[71285]:   <name>instance-00000015</name>
Apr 13 20:26:15 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:26:15 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:26:15 user nova-compute[71285]:   <metadata>
Apr 13 20:26:15 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:26:15 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-890810329</nova:name>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:26:15</nova:creationTime>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:26:15 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:26:15 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:owner>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:user uuid="49383d6f0e7141548370d8bc3b96dfd9">tempest-AttachVolumeNegativeTest-1371087403-project-member</nova:user>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:project uuid="053f656470d94d2a9140f393bad01000">tempest-AttachVolumeNegativeTest-1371087403</nova:project>
Apr 13 20:26:15 user nova-compute[71285]:       </nova:owner>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:26:15 user nova-compute[71285]:       <nova:ports>
Apr 13 20:26:15 user nova-compute[71285]:         <nova:port uuid="f0e44a58-4298-4a38-8717-df1a77e07a08">
Apr 13 20:26:15 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 20:26:15 user nova-compute[71285]:         </nova:port>
Apr 13 20:26:15 user nova-compute[71285]:       </nova:ports>
Apr 13 20:26:15 user nova-compute[71285]:     </nova:instance>
Apr 13 20:26:15 user nova-compute[71285]:   </metadata>
Apr 13 20:26:15 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:26:15 user nova-compute[71285]:     <system>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="serial">24a4358f-82a4-408d-8206-49f05579b45e</entry>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="uuid">24a4358f-82a4-408d-8206-49f05579b45e</entry>
Apr 13 20:26:15 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:26:15 user nova-compute[71285]:     </system>
Apr 13 20:26:15 user nova-compute[71285]:   </sysinfo>
Apr 13 20:26:15 user nova-compute[71285]:   <os>
Apr 13 20:26:15 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:26:15 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:26:15 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:26:15 user nova-compute[71285]:   </os>
Apr 13 20:26:15 user nova-compute[71285]:   <features>
Apr 13 20:26:15 user nova-compute[71285]:     <acpi/>
Apr 13 20:26:15 user nova-compute[71285]:     <apic/>
Apr 13 20:26:15 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:26:15 user nova-compute[71285]:   </features>
Apr 13 20:26:15 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:26:15 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:26:15 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:26:15 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:26:15 user nova-compute[71285]:   </clock>
Apr 13 20:26:15 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:26:15 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:26:15 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:26:15 user nova-compute[71285]:   </cpu>
Apr 13 20:26:15 user nova-compute[71285]:   <devices>
Apr 13 20:26:15 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:26:15 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:26:15 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk"/>
Apr 13 20:26:15 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:26:15 user nova-compute[71285]:     </disk>
Apr 13 20:26:15 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:26:15 user nova-compute[71285]:       <mac address="fa:16:3e:de:a2:63"/>
Apr 13 20:26:15 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:15 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:26:15 user nova-compute[71285]:       <target dev="tapf0e44a58-42"/>
Apr 13 20:26:15 user nova-compute[71285]:     </interface>
Apr 13 20:26:15 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:26:15 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/console.log" append="off"/>
Apr 13 20:26:15 user nova-compute[71285]:     </serial>
Apr 13 20:26:15 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:26:15 user nova-compute[71285]:     <video>
Apr 13 20:26:15 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:15 user nova-compute[71285]:     </video>
Apr 13 20:26:15 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:26:15 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:26:15 user nova-compute[71285]:     </rng>
Apr 13 20:26:15 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:26:15 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:26:15 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:26:15 user nova-compute[71285]:     </memballoon>
Apr 13 20:26:15 user nova-compute[71285]:   </devices>
Apr 13 20:26:15 user nova-compute[71285]: </domain>
Apr 13 20:26:15 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890810329',display_name='tempest-AttachVolumeNegativeTest-server-890810329',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890810329',id=21,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjITfErfI5lYMl/OBfOsCubod6xMYka7P1ow+hjTuaL7Z7vxoMaZ0i9tj7r9D26pmmekOuT/r6BdP2VqLpZ7VwGSf0pHHbaPbZEooTvFfELXkkm7TGz+xl7EPns2IjPgA==',key_name='tempest-keypair-1549482162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-x9aw405s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:26:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=24a4358f-82a4-408d-8206-49f05579b45e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG os_vif [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0e44a58-42, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0e44a58-42, col_values=(('external_ids', {'iface-id': 'f0e44a58-4298-4a38-8717-df1a77e07a08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a2:63', 'vm-uuid': '24a4358f-82a4-408d-8206-49f05579b45e'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:15 user nova-compute[71285]: INFO os_vif [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42')
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:de:a2:63, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updated VIF entry in instance network info cache for port f0e44a58-4298-4a38-8717-df1a77e07a08. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updating instance_info_cache with network_info: [{"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a7ae8bd-7040-42f4-bc8d-40a9810c728c req-a13c62b4-42cf-4d74-a881-44ef9eea0c0e service nova] Releasing lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] No waiting events found dispatching network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:17 user nova-compute[71285]: WARNING nova.compute.manager [req-3ca8c23a-971d-46c9-881b-645c50a50b93 req-3b51b300-66b9-4639-989f-664d559aff24 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received unexpected event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 for instance with vm_state building and task_state spawning.
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417579.044311, 24a4358f-82a4-408d-8206-49f05579b45e => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] VM Resumed (Lifecycle Event)
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Instance spawned successfully.
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] No waiting events found dispatching network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:19 user nova-compute[71285]: WARNING nova.compute.manager [req-a3f7a91c-c48e-457e-b5cf-18cde0c203e2 req-6123be55-f432-49bf-938b-0afff769453c service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received unexpected event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 for instance with vm_state building and task_state spawning.
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417579.044474, 24a4358f-82a4-408d-8206-49f05579b45e => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] VM Started (Lifecycle Event)
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Took 5.84 seconds to spawn the instance on the hypervisor.
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.manager [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Took 6.57 seconds to build instance.
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-131d4fc4-2c9f-4839-993c-97a9246408ae tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.665s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:26:19 user nova-compute[71285]: INFO nova.compute.claims [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Claim successful on node user
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:26:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.policy [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36e11efc98604eb7a8d5b95563431e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '405aed9fca044ab39eabe188942230d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:26:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Creating image(s)
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.157s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk 1073741824" returned: 0 in 0.054s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:26:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Successfully created port: a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Cannot resize image /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'migration_context' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Ensure instance console log exists: /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Successfully updated port: a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing instance network info cache due to event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance network_info: |[{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.neutron [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start _get_guest_xml network_info=[{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:26:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bjG5pVyew1iMJGqVQAxyEL2SLVPg9WtjkR2GAHwrOAtXUXLy5O5gyuSVZRjngyh7gzHwecvMgf5lTzLtkHEU+E+Li7QlCYySw1RXDYaRvTOjrN0y1RquDWwlSaxchVw==',key_name='tempest-keypair-103925243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:26:22 user nova-compute[71285]:   <uuid>4c067bb3-5a8d-4198-9b35-bf8dc2a98962</uuid>
Apr 13 20:26:22 user nova-compute[71285]:   <name>instance-00000016</name>
Apr 13 20:26:22 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:26:22 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:26:22 user nova-compute[71285]:   <metadata>
Apr 13 20:26:22 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:26:22 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1206860275</nova:name>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:26:22</nova:creationTime>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:26:22 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:26:22 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:owner>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:user uuid="36e11efc98604eb7a8d5b95563431e45">tempest-AttachVolumeShelveTestJSON-160294736-project-member</nova:user>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:project uuid="405aed9fca044ab39eabe188942230d2">tempest-AttachVolumeShelveTestJSON-160294736</nova:project>
Apr 13 20:26:22 user nova-compute[71285]:       </nova:owner>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:26:22 user nova-compute[71285]:       <nova:ports>
Apr 13 20:26:22 user nova-compute[71285]:         <nova:port uuid="a573f361-5e24-4509-aa70-50df8b98cf0d">
Apr 13 20:26:22 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 20:26:22 user nova-compute[71285]:         </nova:port>
Apr 13 20:26:22 user nova-compute[71285]:       </nova:ports>
Apr 13 20:26:22 user nova-compute[71285]:     </nova:instance>
Apr 13 20:26:22 user nova-compute[71285]:   </metadata>
Apr 13 20:26:22 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:26:22 user nova-compute[71285]:     <system>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="serial">4c067bb3-5a8d-4198-9b35-bf8dc2a98962</entry>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="uuid">4c067bb3-5a8d-4198-9b35-bf8dc2a98962</entry>
Apr 13 20:26:22 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:26:22 user nova-compute[71285]:     </system>
Apr 13 20:26:22 user nova-compute[71285]:   </sysinfo>
Apr 13 20:26:22 user nova-compute[71285]:   <os>
Apr 13 20:26:22 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:26:22 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:26:22 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:26:22 user nova-compute[71285]:   </os>
Apr 13 20:26:22 user nova-compute[71285]:   <features>
Apr 13 20:26:22 user nova-compute[71285]:     <acpi/>
Apr 13 20:26:22 user nova-compute[71285]:     <apic/>
Apr 13 20:26:22 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:26:22 user nova-compute[71285]:   </features>
Apr 13 20:26:22 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:26:22 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:26:22 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:26:22 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:26:22 user nova-compute[71285]:   </clock>
Apr 13 20:26:22 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:26:22 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:26:22 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:26:22 user nova-compute[71285]:   </cpu>
Apr 13 20:26:22 user nova-compute[71285]:   <devices>
Apr 13 20:26:22 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:26:22 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:26:22 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk"/>
Apr 13 20:26:22 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:26:22 user nova-compute[71285]:     </disk>
Apr 13 20:26:22 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:26:22 user nova-compute[71285]:       <mac address="fa:16:3e:e3:4d:81"/>
Apr 13 20:26:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:22 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:26:22 user nova-compute[71285]:       <target dev="tapa573f361-5e"/>
Apr 13 20:26:22 user nova-compute[71285]:     </interface>
Apr 13 20:26:22 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:26:22 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/console.log" append="off"/>
Apr 13 20:26:22 user nova-compute[71285]:     </serial>
Apr 13 20:26:22 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:26:22 user nova-compute[71285]:     <video>
Apr 13 20:26:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:26:22 user nova-compute[71285]:     </video>
Apr 13 20:26:22 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:26:22 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:26:22 user nova-compute[71285]:     </rng>
Apr 13 20:26:22 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:26:22 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:26:22 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:26:22 user nova-compute[71285]:     </memballoon>
Apr 13 20:26:22 user nova-compute[71285]:   </devices>
Apr 13 20:26:22 user nova-compute[71285]: </domain>
Apr 13 20:26:22 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bjG5pVyew1iMJGqVQAxyEL2SLVPg9WtjkR2GAHwrOAtXUXLy5O5gyuSVZRjngyh7gzHwecvMgf5lTzLtkHEU+E+Li7QlCYySw1RXDYaRvTOjrN0y1RquDWwlSaxchVw==',key_name='tempest-keypair-103925243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:26:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG os_vif [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa573f361-5e, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa573f361-5e, col_values=(('external_ids', {'iface-id': 'a573f361-5e24-4509-aa70-50df8b98cf0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:4d:81', 'vm-uuid': '4c067bb3-5a8d-4198-9b35-bf8dc2a98962'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:22 user nova-compute[71285]: INFO os_vif [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e')
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:26:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No VIF found with MAC fa:16:3e:e3:4d:81, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:26:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updated VIF entry in instance network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:26:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5bf93edf-db4e-48bf-9814-944d8a20f005 req-c1ec4246-5c77-4f20-a41f-6f5a29e58b54 service nova] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417569.0854166, 54d25a51-cd3f-4ea1-9de4-66de37fcb476 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:24 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] VM Stopped (Lifecycle Event)
Apr 13 20:26:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ffe3c1b3-696a-4f22-90b6-222149437f68 None None] [instance: 54d25a51-cd3f-4ea1-9de4-66de37fcb476] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:24 user nova-compute[71285]: WARNING nova.compute.manager [req-eba97660-26a8-48c1-9259-a3e72762dfd7 req-baeff389-d336-4dba-a92f-da05ccf23d70 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state building and task_state spawning.
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417586.424842, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Resumed (Lifecycle Event)
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance spawned successfully.
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417586.4265149, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Started (Lifecycle Event)
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:26 user nova-compute[71285]: WARNING nova.compute.manager [req-de510760-6134-4e86-a850-080990a8fc31 req-12d9b829-b6ea-4127-adb5-d3ed15b51983 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state building and task_state spawning.
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 13 20:26:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:26:26 user nova-compute[71285]: INFO nova.compute.manager [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Took 6.94 seconds to build instance.
Apr 13 20:26:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-227bc9db-66cb-48d8-90ae-d01f10cc0aad tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.034s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:45 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing instance network info cache due to event network-changed-4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Acquiring lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Acquired lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Refreshing network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:48 user nova-compute[71285]: INFO nova.compute.manager [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Terminating instance
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updated VIF entry in instance network info cache for port 4c29a89c-5e3a-42f4-a315-8c579dc498ea. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [{"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d8cd5d8-6663-40ed-aa33-e742d12002e3 req-48cbe570-7163-44a6-9dda-f46270532899 service nova] Releasing lock "refresh_cache-5ae3eea8-5d28-46eb-8e84-86958032a048" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Instance destroyed successfully.
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.objects.instance [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'resources' on Instance uuid 5ae3eea8-5d28-46eb-8e84-86958032a048 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1024576911',display_name='tempest-TestStampPattern-server-1024576911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1024576911',id=17,image_ref='0a3095d4-082a-4c70-84d0-8daaa3d5d513',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:24:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-w7m8f0lp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b9e0bb04-2572-4973-af9c-a607ca0b170b',image_min_disk='1',image_min_ram='0',image_owner_id='d32350a5bf9a4d8b80c6bc1708387d1f',image_owner_project_name='tempest-TestStampPattern-1872935518',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1872935518-project-member',image_user_id='29ed39378db34acd835d13c0cacad399',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:24:06Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=5ae3eea8-5d28-46eb-8e84-86958032a048,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "address": "fa:16:3e:ca:bc:23", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c29a89c-5e", "ovs_interfaceid": "4c29a89c-5e3a-42f4-a315-8c579dc498ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG os_vif [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c29a89c-5e, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:48 user nova-compute[71285]: INFO os_vif [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:bc:23,bridge_name='br-int',has_traffic_filtering=True,id=4c29a89c-5e3a-42f4-a315-8c579dc498ea,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c29a89c-5e')
Apr 13 20:26:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Deleting instance files /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048_del
Apr 13 20:26:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Deletion of /opt/stack/data/nova/instances/5ae3eea8-5d28-46eb-8e84-86958032a048_del complete
Apr 13 20:26:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: INFO nova.compute.manager [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-vif-deleted-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:49 user nova-compute[71285]: INFO nova.compute.manager [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Neutron deleted interface 4c29a89c-5e3a-42f4-a315-8c579dc498ea; detaching it from the instance and deleting it from the info cache
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.network.neutron [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:49 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Took 0.52 seconds to deallocate network for instance.
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-7092dd43-c0a0-4964-b9d8-6ba195dcbeb9 req-e9181dd3-1b5d-4420-b4ae-46780794bc68 service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Detach interface failed, port_id=4c29a89c-5e3a-42f4-a315-8c579dc498ea, reason: Instance 5ae3eea8-5d28-46eb-8e84-86958032a048 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:49 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-vif-unplugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] No waiting events found dispatching network-vif-unplugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:50 user nova-compute[71285]: WARNING nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received unexpected event network-vif-unplugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance with vm_state deleted and task_state None.
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Acquiring lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] No waiting events found dispatching network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:50 user nova-compute[71285]: WARNING nova.compute.manager [req-bafc07c4-46fb-4976-a2ae-fe87d2747fac req-0b2af344-c652-42dd-b1ef-a239abfb930e service nova] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Received unexpected event network-vif-plugged-4c29a89c-5e3a-42f4-a315-8c579dc498ea for instance with vm_state deleted and task_state None.
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:26:50 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Deleted allocations for instance 5ae3eea8-5d28-46eb-8e84-86958032a048
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-500c17d0-f938-4e17-9566-56e585fffbbe tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "5ae3eea8-5d28-46eb-8e84-86958032a048" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:26:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7548MB free_disk=26.33913803100586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b9e0bb04-2572-4973-af9c-a607ca0b170b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a369e185-3d75-4dde-8e8a-0e397aab892b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 24a4358f-82a4-408d-8206-49f05579b45e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:26:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:26:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:51 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:26:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:26:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:57 user nova-compute[71285]: INFO nova.compute.manager [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Terminating instance
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-unplugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] No waiting events found dispatching network-vif-unplugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce5004bc-8a5f-4e12-adbb-e6a5d8603dba req-1a893d07-be6f-4a9e-b320-df3227160471 service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-unplugged-27e6da64-070b-4a09-8874-138a9490d844 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:26:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Instance destroyed successfully.
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'resources' on Instance uuid 31f49fca-6bb7-4297-b903-4c4ddbe325cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:25:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1606749477',display_name='tempest-ServersNegativeTestJSON-server-1606749477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1606749477',id=20,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:25:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-mha7gvea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:25:13Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=31f49fca-6bb7-4297-b903-4c4ddbe325cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "27e6da64-070b-4a09-8874-138a9490d844", "address": "fa:16:3e:c9:7c:7d", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27e6da64-07", "ovs_interfaceid": "27e6da64-070b-4a09-8874-138a9490d844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG os_vif [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27e6da64-07, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:26:57 user nova-compute[71285]: INFO os_vif [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:7c:7d,bridge_name='br-int',has_traffic_filtering=True,id=27e6da64-070b-4a09-8874-138a9490d844,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27e6da64-07')
Apr 13 20:26:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Deleting instance files /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf_del
Apr 13 20:26:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Deletion of /opt/stack/data/nova/instances/31f49fca-6bb7-4297-b903-4c4ddbe325cf_del complete
Apr 13 20:26:57 user nova-compute[71285]: INFO nova.compute.manager [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 20:26:57 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:26:57 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:26:58 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Took 0.43 seconds to deallocate network for instance.
Apr 13 20:26:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-7d35df37-c1b4-4c6f-b9c4-eb3898ec3faf req-a8d9c62c-fa9f-475d-b8ac-fa6f278da67d service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-deleted-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:26:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:58 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Deleted allocations for instance 31f49fca-6bb7-4297-b903-4c4ddbe325cf
Apr 13 20:26:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb2b1831-ba30-4117-a39c-a4db1283ac1f tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.816s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:26:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Acquiring lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:26:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:26:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] Lock "31f49fca-6bb7-4297-b903-4c4ddbe325cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:26:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] No waiting events found dispatching network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:26:59 user nova-compute[71285]: WARNING nova.compute.manager [req-c1fa6ef7-c803-48d0-95ee-b0a2ce7441b2 req-633166c9-cd37-49db-85b1-1f284ca5f56c service nova] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Received unexpected event network-vif-plugged-27e6da64-070b-4a09-8874-138a9490d844 for instance with vm_state deleted and task_state None.
Apr 13 20:27:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:03 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417608.8660831, 5ae3eea8-5d28-46eb-8e84-86958032a048 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:27:03 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] VM Stopped (Lifecycle Event)
Apr 13 20:27:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-bf0c8006-f225-4707-9acd-d30f47726d32 None None] [instance: 5ae3eea8-5d28-46eb-8e84-86958032a048] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:27:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:12 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417617.7980032, 31f49fca-6bb7-4297-b903-4c4ddbe325cf => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:27:12 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] VM Stopped (Lifecycle Event)
Apr 13 20:27:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3c0d682d-9adb-4496-8b8f-6b08a874efc2 None None] [instance: 31f49fca-6bb7-4297-b903-4c4ddbe325cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:27:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:27:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:27:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing instance network info cache due to event network-changed-a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Acquiring lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Acquired lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Refreshing network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:43 user nova-compute[71285]: INFO nova.compute.manager [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Terminating instance
Apr 13 20:27:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updated VIF entry in instance network info cache for port a174e8a4-6618-4819-92fe-4e08da521d07. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [{"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f2cc0a7-3250-4164-bdb3-e4d70e93b9e1 req-d4c07037-0295-4430-b270-d3bd98e363ab service nova] Releasing lock "refresh_cache-b9e0bb04-2572-4973-af9c-a607ca0b170b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Instance destroyed successfully.
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lazy-loading 'resources' on Instance uuid b9e0bb04-2572-4973-af9c-a607ca0b170b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:20:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1172702095',display_name='tempest-TestStampPattern-server-1172702095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1172702095',id=11,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUQBh930yqIsWrBpzChPqUfFp84iq6xAXnNoODiDjwhy0hNv3njy7LifFS5jQw8IWaidr5Dh/6719yRbd7zDLecV87ml5BsrcFT0GxFC5jbzM3qXODNWUP4nPzF1zUpRQ==',key_name='tempest-TestStampPattern-1904080569',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:20:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d32350a5bf9a4d8b80c6bc1708387d1f',ramdisk_id='',reservation_id='r-8fuqihak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1872935518',owner_user_name='tempest-TestStampPattern-1872935518-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:23:50Z,user_data=None,user_id='29ed39378db34acd835d13c0cacad399',uuid=b9e0bb04-2572-4973-af9c-a607ca0b170b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converting VIF {"id": "a174e8a4-6618-4819-92fe-4e08da521d07", "address": "fa:16:3e:58:bb:03", "network": {"id": "2e78e6b2-a44b-40bd-a389-7c280074091d", "bridge": "br-int", "label": "tempest-TestStampPattern-1803833095-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d32350a5bf9a4d8b80c6bc1708387d1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa174e8a4-66", "ovs_interfaceid": "a174e8a4-6618-4819-92fe-4e08da521d07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG os_vif [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa174e8a4-66, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:44 user nova-compute[71285]: INFO os_vif [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:bb:03,bridge_name='br-int',has_traffic_filtering=True,id=a174e8a4-6618-4819-92fe-4e08da521d07,network=Network(2e78e6b2-a44b-40bd-a389-7c280074091d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa174e8a4-66')
Apr 13 20:27:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Deleting instance files /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b_del
Apr 13 20:27:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Deletion of /opt/stack/data/nova/instances/b9e0bb04-2572-4973-af9c-a607ca0b170b_del complete
Apr 13 20:27:44 user nova-compute[71285]: INFO nova.compute.manager [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 20:27:44 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:27:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:27:45 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Took 0.46 seconds to deallocate network for instance.
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:45 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Deleted allocations for instance b9e0bb04-2572-4973-af9c-a607ca0b170b
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4974a99-c54f-4fe4-a5ff-1b864129804e tempest-TestStampPattern-1872935518 tempest-TestStampPattern-1872935518-project-member] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.855s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-vif-unplugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] No waiting events found dispatching network-vif-unplugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:45 user nova-compute[71285]: WARNING nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received unexpected event network-vif-unplugged-a174e8a4-6618-4819-92fe-4e08da521d07 for instance with vm_state deleted and task_state None.
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Acquiring lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] Lock "b9e0bb04-2572-4973-af9c-a607ca0b170b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] No waiting events found dispatching network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:45 user nova-compute[71285]: WARNING nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received unexpected event network-vif-plugged-a174e8a4-6618-4819-92fe-4e08da521d07 for instance with vm_state deleted and task_state None.
Apr 13 20:27:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9dc06ac-c13c-4cf9-b583-3b0b850a34b0 req-36613916-4ae5-400b-b131-c01677f128f8 service nova] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Received event network-vif-deleted-a174e8a4-6618-4819-92fe-4e08da521d07 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'flavor' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:47 user nova-compute[71285]: INFO nova.compute.manager [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attaching volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c to /dev/vdb
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.utils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18c13a-cc40-4c00-b4b1-35ecb3f39d1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770c4fa-55d9-4df4-a8e1-8b71eb871070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbbe3b8-32bb-498a-aea4-22d575ba38a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc821ee-24f4-4419-ad7a-9c4446dc9875]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:27:47 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a966d323-77b2-41df-928b-f10330319416]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG os_brick.utils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating existing volume attachment record: 62eb34db-ff2b-4b48-a3d1-84f256725c9a {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:49 user nova-compute[71285]: INFO nova.compute.manager [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Detaching volume 6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:27:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:27:49 user nova-compute[71285]: INFO nova.virt.block_device [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Attempting to driver detach volume 6aa89e26-6353-427a-a9ef-10c96effef8e from mountpoint /dev/vdb
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Attempting to detach device vdb from instance 7d01394e-edb8-4c51-a71a-e07c0ee164db from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:27:49 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:27:49 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:27:49 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:27:49 user nova-compute[71285]:   <serial>6aa89e26-6353-427a-a9ef-10c96effef8e</serial>
Apr 13 20:27:49 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:27:49 user nova-compute[71285]: </disk>
Apr 13 20:27:49 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:27:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdb from instance 7d01394e-edb8-4c51-a71a-e07c0ee164db from the persistent domain config.
Apr 13 20:27:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d01394e-edb8-4c51-a71a-e07c0ee164db from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:27:49 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:27:49 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:27:49 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:27:49 user nova-compute[71285]:   <serial>6aa89e26-6353-427a-a9ef-10c96effef8e</serial>
Apr 13 20:27:49 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:27:49 user nova-compute[71285]: </disk>
Apr 13 20:27:49 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417670.1985428, 7d01394e-edb8-4c51-a71a-e07c0ee164db => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:27:50 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdb from instance 7d01394e-edb8-4c51-a71a-e07c0ee164db from the live domain config.
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zVxuXTeW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:50 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8745cc-7150-4345-9299-6acf72791975]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:27:50 user nova-compute[71285]: No targets found.
Apr 13 20:27:50 user nova-compute[71285]: iSNS:
Apr 13 20:27:50 user nova-compute[71285]: No targets found.
Apr 13 20:27:50 user nova-compute[71285]: STATIC:
Apr 13 20:27:50 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959
Apr 13 20:27:50 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:27:50 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:27:50 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e
Apr 13 20:27:50 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:27:50 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:27:50 user nova-compute[71285]: FIRMWARE:
Apr 13 20:27:50 user nova-compute[71285]: No targets found.
Apr 13 20:27:50 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:27:50 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:27:50 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fcba4d-fa80-469d-a6b7-5bcffa73f5bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd7435d-30f3-48d5-b195-4be614956453]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:27:50 user nova-compute[71285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:50 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e (non-flash)
Apr 13 20:27:50 user nova-compute[71285]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:50 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0d98d-d86b-41f5-8913-f17fc9760a55]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:27:50 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7934MB free_disk=26.440135955810547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[902eba1c-cf7b-4808-bec6-c44f3fc0e87f]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9bda7-805f-41d1-9e7b-8fcc6daeb23f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa349baa-cadd-456c-85c4-74ec53b1ad7d]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90302bc4-0bc1-4702-889b-393742e4b92b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a369e185-3d75-4dde-8e8a-0e397aab892b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 24a4358f-82a4-408d-8206-49f05579b45e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1baa349-bc41-4ffd-9af8-8c85a8357a77]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260]
Apr 13 20:27:50 user nova-compute[71285]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e, portal: 172.16.0.220,3260] successful.
Apr 13 20:27:50 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6aa89e26-6353-427a-a9ef-10c96effef8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6412a876-e3c8-4be8-a80b-8f180fcd1c4f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.733s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== disconnect_volume: return (736ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:27:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:27:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:27:51 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:27:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.objects.instance [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-01c4f634-0072-48cd-a63c-e4051cb9b141 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.709s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:52 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:27:52 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:27:52 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f821a-0534-486f-8127-4ae4b9f9a139]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:27:52 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae55899-f399-4d5c-9810-837af08e3090]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c] added
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a40048-a705-4916-8532-42fd25741671]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc5e845-c3a6-4747-9952-29a09a53cd87]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSWftHRO {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSWftHRO" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ce20e0-fe1f-4602-891e-05ec3dd23a1f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSWftHRO'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2e3815-357f-4796-8e4f-1460c9c2436b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d06ecd-6ad5-4f9e-9bea-dfbff7f40a37]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c6597e-69e8-4f89-ac07-e411e78a69c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]
Apr 13 20:27:52 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f38143-5464-4786-b6c4-a0fa8ecfde27]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad4770-118d-4561-9531-a1036c205647]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:52 user nova-compute[71285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:52 user nova-compute[71285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:27:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updating instance_info_cache with network_info: [{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aabb1c-a80d-4a8a-8253-04bcbead89ef]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71285) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:53 user nova-compute[71285]: WARNING nova.compute.manager [req-f2e3a1b7-f22b-4879-ad3b-4ec90ecb55d5 req-7e76732f-1f5f-4855-820d-8f560c0bf167 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state active and task_state powering-off.
Apr 13 20:27:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance destroyed successfully.
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d5231bb6-6adb-4c8b-887e-d264ad65b6a2 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.841s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26234333432353565', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333432353565', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'flavor' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:27:53 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:27:53 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:27:53 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:27:53 user nova-compute[71285]:   <serial>1017ad5b-45cd-4f0b-a368-4af26c71c74c</serial>
Apr 13 20:27:53 user nova-compute[71285]: </disk>
Apr 13 20:27:53 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:27:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:27:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:27:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:a6:33:90, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:27:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4e3b7730-262c-4072-b321-4413231119a4 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.779s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:55 user nova-compute[71285]: WARNING nova.compute.manager [req-c5627a16-64f7-4eaa-bbca-e520143ffc41 req-e421cbb2-c450-4183-80e1-019306680ac2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state stopped and task_state None.
Apr 13 20:27:55 user nova-compute[71285]: INFO nova.compute.manager [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Rebuilding instance
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_requests' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'migration_context' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71285) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:56 user nova-compute[71285]: WARNING nova.compute.manager [req-0760f18b-de87-461c-9233-b67fb5464dd5 req-b9771bfc-8d4d-45bc-98c6-f9961f5a1b87 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state rebuilding.
Apr 13 20:27:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance destroyed successfully.
Apr 13 20:27:56 user nova-compute[71285]: INFO nova.compute.manager [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Detaching volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:27:56 user nova-compute[71285]: INFO nova.virt.block_device [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attempting to driver detach volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c from mountpoint /dev/vdb
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Attempting to detach device vdb from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:27:56 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:27:56 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:27:56 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:27:56 user nova-compute[71285]:   <serial>1017ad5b-45cd-4f0b-a368-4af26c71c74c</serial>
Apr 13 20:27:56 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:27:56 user nova-compute[71285]: </disk>
Apr 13 20:27:56 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:27:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully detached device vdb from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the persistent domain config.
Apr 13 20:27:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:56 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 20:27:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:27:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fec3f8-d8f3-40e0-94a3-da75ebee58b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:27:57 user nova-compute[71285]: No targets found.
Apr 13 20:27:57 user nova-compute[71285]: iSNS:
Apr 13 20:27:57 user nova-compute[71285]: No targets found.
Apr 13 20:27:57 user nova-compute[71285]: STATIC:
Apr 13 20:27:57 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959
Apr 13 20:27:57 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:27:57 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:27:57 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:27:57 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:27:57 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:27:57 user nova-compute[71285]: FIRMWARE:
Apr 13 20:27:57 user nova-compute[71285]: No targets found.
Apr 13 20:27:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:27:57 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:27:57 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fff9c7-eb88-4114-9626-211f90c0baaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a12f2-888e-4f71-8e57-6f86fc73708f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:57 user nova-compute[71285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:27:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:57 user nova-compute[71285]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:27:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6473c310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ebb6ba-e3b3-4dd0-8c94-05648d47a5b0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62f83ca-3558-4954-8c13-a90384124a06]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f2c83-f842-46e4-902e-d566d5c6fac1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df498795-613d-4224-b348-aa844e473296]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[180d9b95-04a3-40f9-948a-0b942e59f5dc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bee9f05-bcc4-4722-b71d-372e3c365e39]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]
Apr 13 20:27:57 user nova-compute[71285]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.
Apr 13 20:27:57 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[763bc52f-2179-492f-b3e3-8ad84b9fe479]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (319ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:27:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance destroyed successfully.
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:27:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0918fa-03, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:27:58 user nova-compute[71285]: INFO os_vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:58 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[103ee891-1129-40da-90f5-c05944fa8cc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:27:58 user nova-compute[71285]: No targets found.
Apr 13 20:27:58 user nova-compute[71285]: iSNS:
Apr 13 20:27:58 user nova-compute[71285]: No targets found.
Apr 13 20:27:58 user nova-compute[71285]: STATIC:
Apr 13 20:27:58 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959
Apr 13 20:27:58 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:27:58 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:27:58 user nova-compute[71285]: FIRMWARE:
Apr 13 20:27:58 user nova-compute[71285]: No targets found.
Apr 13 20:27:58 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:27:58 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:27:58 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ad852a-8914-4923-ace1-fbd5f8018a12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781d0f3-70fb-4604-9216-0556a0496cec]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:58 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:27:58 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a779a0>, {}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (72ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:27:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Deleting instance files /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_del
Apr 13 20:27:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Deletion of /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_del complete
Apr 13 20:27:58 user nova-compute[71285]: INFO nova.virt.block_device [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Booting with volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c at /dev/vdb
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.utils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf13b90-5593-409c-821d-8d8a88c85349]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc624891-4ec8-4c8a-a519-318d6e35bfc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:27:58 user nova-compute[71285]: WARNING nova.compute.manager [req-759f91a0-d601-4528-9eba-6fce8c586661 req-69f14133-b531-436d-bc8b-9b8488d159d0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state rebuild_block_device_mapping.
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[feab52e9-4073-4790-9146-fb9f590c5fec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a8122d-1c2d-4180-96f8-f9ae284dd33c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:27:58 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:27:58 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeecd47-bc7d-4823-8ac4-4972bbc9754d]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG os_brick.utils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:27:58 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating existing volume attachment record: 61918900-adbd-4fdd-9c27-d2baa84fe1d9 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:27:59 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417664.600291, b9e0bb04-2572-4973-af9c-a607ca0b170b => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:27:59 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] VM Stopped (Lifecycle Event)
Apr 13 20:27:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-45af7241-0ea4-498f-99bf-34941f22e513 None None] [instance: b9e0bb04-2572-4973-af9c-a607ca0b170b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:28:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating image(s)
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk 1073741824" returned: 0 in 0.053s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Cannot resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Ensure instance console log exists: /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start _get_guest_xml network_info=[{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8bcf189-a781-474e-bc4f-8a471a661e93', 'attached_at': '', 'detached_at': '', 'volume_id': '1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'serial': '1017ad5b-45cd-4f0b-a368-4af26c71c74c'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '61918900-adbd-4fdd-9c27-d2baa84fe1d9', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:28:03 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 20:28:03 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:28:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:28:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:28:03 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f9736-1c66-4801-8d7c-e7a95035479e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:28:03 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e645fbc-672e-40db-8e7b-4c023342ec97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c] added
Apr 13 20:28:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc3fe00-7521-4c55-84aa-20a2c78b85df]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b5502-81c0-4f77-ac1c-53a589278b15]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSWftHRO {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bSWftHRO" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7634e78f-a2fc-4d74-9ae3-64414667c43f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bSWftHRO'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e501f4f-e546-4f8d-b226-70f92e03d884]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c5ddb4-03c0-4b72-9f5e-aaf1d4ca6307]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abff9bd-1cee-4449-8bff-437e9efa3b1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]
Apr 13 20:28:03 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.
Apr 13 20:28:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad9815-55a3-4baf-bf75-d1ce0d646417]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bdefd8-f822-4a7e-85f6-daec36ebbdff]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:04 user nova-compute[71285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:28:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:04 user nova-compute[71285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:28:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9470971-c844-4a86-bb05-139ed87a545c]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-changed-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Refreshing instance network info cache due to event network-changed-f0e44a58-4298-4a38-8717-df1a77e07a08. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Acquiring lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Acquired lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Refreshing network info cache for port f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:04 user nova-compute[71285]: INFO nova.compute.manager [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Terminating instance
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updated VIF entry in instance network info cache for port f0e44a58-4298-4a38-8717-df1a77e07a08. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updating instance_info_cache with network_info: [{"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-54b30dd1-946a-473a-9266-b9c41d4944c0 req-a273dd9b-c86e-4bb9-b1be-76ae36bc9207 service nova] Releasing lock "refresh_cache-24a4358f-82a4-408d-8206-49f05579b45e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-unplugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] No waiting events found dispatching network-vif-unplugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-00fc0ee5-c373-44f5-9287-994d8c16783b req-816899ae-382a-48a2-9b92-ffc68a618388 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-unplugged-f0e44a58-4298-4a38-8717-df1a77e07a08 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Instance destroyed successfully.
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'resources' on Instance uuid 24a4358f-82a4-408d-8206-49f05579b45e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-890810329',display_name='tempest-AttachVolumeNegativeTest-server-890810329',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-890810329',id=21,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjITfErfI5lYMl/OBfOsCubod6xMYka7P1ow+hjTuaL7Z7vxoMaZ0i9tj7r9D26pmmekOuT/r6BdP2VqLpZ7VwGSf0pHHbaPbZEooTvFfELXkkm7TGz+xl7EPns2IjPgA==',key_name='tempest-keypair-1549482162',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:26:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-x9aw405s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:26:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=24a4358f-82a4-408d-8206-49f05579b45e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "f0e44a58-4298-4a38-8717-df1a77e07a08", "address": "fa:16:3e:de:a2:63", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0e44a58-42", "ovs_interfaceid": "f0e44a58-4298-4a38-8717-df1a77e07a08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG os_vif [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0e44a58-42, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:28:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:04 user nova-compute[71285]: INFO os_vif [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a2:63,bridge_name='br-int',has_traffic_filtering=True,id=f0e44a58-4298-4a38-8717-df1a77e07a08,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0e44a58-42')
Apr 13 20:28:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Deleting instance files /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e_del
Apr 13 20:28:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Deletion of /opt/stack/data/nova/instances/24a4358f-82a4-408d-8206-49f05579b45e_del complete
Apr 13 20:28:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26234333432353565', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234333432353565', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:28:05 user nova-compute[71285]: INFO nova.compute.manager [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 13 20:28:05 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:28:05 user nova-compute[71285]:   <uuid>b8bcf189-a781-474e-bc4f-8a471a661e93</uuid>
Apr 13 20:28:05 user nova-compute[71285]:   <name>instance-00000012</name>
Apr 13 20:28:05 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:28:05 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:28:05 user nova-compute[71285]:   <metadata>
Apr 13 20:28:05 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:28:05 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-181194148</nova:name>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:28:03</nova:creationTime>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:28:05 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:28:05 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:owner>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:28:05 user nova-compute[71285]:       </nova:owner>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:28:05 user nova-compute[71285]:       <nova:ports>
Apr 13 20:28:05 user nova-compute[71285]:         <nova:port uuid="2a0918fa-0318-4cee-aa86-e65201b06aa8">
Apr 13 20:28:05 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:28:05 user nova-compute[71285]:         </nova:port>
Apr 13 20:28:05 user nova-compute[71285]:       </nova:ports>
Apr 13 20:28:05 user nova-compute[71285]:     </nova:instance>
Apr 13 20:28:05 user nova-compute[71285]:   </metadata>
Apr 13 20:28:05 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:28:05 user nova-compute[71285]:     <system>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="serial">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="uuid">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:28:05 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:28:05 user nova-compute[71285]:     </system>
Apr 13 20:28:05 user nova-compute[71285]:   </sysinfo>
Apr 13 20:28:05 user nova-compute[71285]:   <os>
Apr 13 20:28:05 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:28:05 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:28:05 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:28:05 user nova-compute[71285]:   </os>
Apr 13 20:28:05 user nova-compute[71285]:   <features>
Apr 13 20:28:05 user nova-compute[71285]:     <acpi/>
Apr 13 20:28:05 user nova-compute[71285]:     <apic/>
Apr 13 20:28:05 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:28:05 user nova-compute[71285]:   </features>
Apr 13 20:28:05 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:28:05 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:28:05 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:28:05 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:28:05 user nova-compute[71285]:   </clock>
Apr 13 20:28:05 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:28:05 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:28:05 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:28:05 user nova-compute[71285]:   </cpu>
Apr 13 20:28:05 user nova-compute[71285]:   <devices>
Apr 13 20:28:05 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:28:05 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:28:05 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk"/>
Apr 13 20:28:05 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:28:05 user nova-compute[71285]:     </disk>
Apr 13 20:28:05 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:28:05 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:28:05 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:28:05 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:28:05 user nova-compute[71285]:       <serial>1017ad5b-45cd-4f0b-a368-4af26c71c74c</serial>
Apr 13 20:28:05 user nova-compute[71285]:     </disk>
Apr 13 20:28:05 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:28:05 user nova-compute[71285]:       <mac address="fa:16:3e:a6:33:90"/>
Apr 13 20:28:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:05 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:28:05 user nova-compute[71285]:       <target dev="tap2a0918fa-03"/>
Apr 13 20:28:05 user nova-compute[71285]:     </interface>
Apr 13 20:28:05 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:28:05 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log" append="off"/>
Apr 13 20:28:05 user nova-compute[71285]:     </serial>
Apr 13 20:28:05 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:28:05 user nova-compute[71285]:     <video>
Apr 13 20:28:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:05 user nova-compute[71285]:     </video>
Apr 13 20:28:05 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:28:05 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:28:05 user nova-compute[71285]:     </rng>
Apr 13 20:28:05 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:28:05 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:28:05 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:28:05 user nova-compute[71285]:     </memballoon>
Apr 13 20:28:05 user nova-compute[71285]:   </devices>
Apr 13 20:28:05 user nova-compute[71285]: </domain>
Apr 13 20:28:05 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG os_vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0918fa-03, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0918fa-03, col_values=(('external_ids', {'iface-id': '2a0918fa-0318-4cee-aa86-e65201b06aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:33:90', 'vm-uuid': 'b8bcf189-a781-474e-bc4f-8a471a661e93'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:05 user nova-compute[71285]: INFO os_vif [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:a6:33:90, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:05 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Took 0.82 seconds to deallocate network for instance.
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-deleted-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:05 user nova-compute[71285]: INFO nova.compute.manager [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Neutron deleted interface f0e44a58-4298-4a38-8717-df1a77e07a08; detaching it from the instance and deleting it from the info cache
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-397aa20e-8c60-4f11-864b-b746ee7b5f33 req-01620859-f876-41fd-9364-763ff3a35718 service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Detach interface failed, port_id=f0e44a58-4298-4a38-8717-df1a77e07a08, reason: Instance 24a4358f-82a4-408d-8206-49f05579b45e could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:06 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Deleted allocations for instance 24a4358f-82a4-408d-8206-49f05579b45e
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca71034d-77f7-462b-bc12-9eabfde1c5e5 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "24a4358f-82a4-408d-8206-49f05579b45e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.960s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Acquiring lock "24a4358f-82a4-408d-8206-49f05579b45e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "24a4358f-82a4-408d-8206-49f05579b45e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] No waiting events found dispatching network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:06 user nova-compute[71285]: WARNING nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Received unexpected event network-vif-plugged-f0e44a58-4298-4a38-8717-df1a77e07a08 for instance with vm_state deleted and task_state None.
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:06 user nova-compute[71285]: WARNING nova.compute.manager [req-38bfe778-325e-4071-87b4-9aa107624980 req-747b4130-920f-4347-853c-7f78d9b2a47e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417673.6534574, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Stopped (Lifecycle Event)
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-086956f9-276f-47db-b84b-748667f33cfd None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-086956f9-276f-47db-b84b-748667f33cfd None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for b8bcf189-a781-474e-bc4f-8a471a661e93 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417688.7262685, b8bcf189-a781-474e-bc4f-8a471a661e93 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Resumed (Lifecycle Event)
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance spawned successfully.
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417688.727456, b8bcf189-a781-474e-bc4f-8a471a661e93 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Started (Lifecycle Event)
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:08 user nova-compute[71285]: WARNING nova.compute.manager [req-85df822a-fae6-4e6a-b4de-6e65e871d77c req-ce019dd2-960b-4093-ad89-c665a4239597 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state rebuild_spawning.
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71285) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 13 20:28:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1595d2e-e495-4027-bc00-af9d90e757b1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.067s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing instance network info cache due to event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:28:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updated VIF entry in instance network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:28:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-21b9870a-03dc-493f-bcce-401261ebb61d req-adeceb1f-be19-4cb8-95af-74ecf80c4fa3 service nova] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:12 user nova-compute[71285]: INFO nova.compute.manager [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Shelving
Apr 13 20:28:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:13 user nova-compute[71285]: WARNING nova.compute.manager [req-73327160-7bab-43ce-8040-9e1427bbaf05 req-ae282f1e-7886-4bf1-93a7-bad3bd49d33e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state active and task_state shelving.
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:28:13 user nova-compute[71285]: INFO nova.compute.claims [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Claim successful on node user
Apr 13 20:28:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance destroyed successfully.
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:28:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Beginning cold snapshot process
Apr 13 20:28:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:28:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:28:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk /opt/stack/data/nova/instances/snapshots/tmp52gc0phv/9d5c60272b1a4c41bf37448d23de82b3 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.policy [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:28:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Creating image(s)
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk /opt/stack/data/nova/instances/snapshots/tmp52gc0phv/9d5c60272b1a4c41bf37448d23de82b3" returned: 0 in 0.646s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Snapshot extracted, beginning image upload
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.part --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.virt.images [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 54a85f0f-585c-4c38-b211-c4a8d01d6811 was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.part /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Successfully created port: 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.part /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.converted" returned: 0 in 0.227s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.923s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json" returned: 0 in 0.198s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:15 user nova-compute[71285]: WARNING nova.compute.manager [req-ce9fcb70-8973-4de4-ba08-213f895acfb5 req-a59c9fc7-e44e-437c-aff8-de08e68fec0e service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state active and task_state shelving_image_uploading.
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469,backing_fmt=raw /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469,backing_fmt=raw /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk 1073741824" returned: 0 in 0.045s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Successfully updated port: 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing instance network info cache due to event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Cannot resize image /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'migration_context' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Ensure instance console log exists: /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance network_info: |[{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start _get_guest_xml network_info=[{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:28:11Z,direct_url=<?>,disk_format='qcow2',id=54a85f0f-585c-4c38-b211-c4a8d01d6811,min_disk=0,min_ram=0,name='tempest-scenario-img--842845850',owner='41f1e999778042e2a606a2ae4072bc83',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:28:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '54a85f0f-585c-4c38-b211-c4a8d01d6811'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:28:16 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:16 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:28:11Z,direct_url=<?>,disk_format='qcow2',id=54a85f0f-585c-4c38-b211-c4a8d01d6811,min_disk=0,min_ram=0,name='tempest-scenario-img--842845850',owner='41f1e999778042e2a606a2ae4072bc83',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:28:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:28:14Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.objects.instance [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'pci_devices' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:28:16 user nova-compute[71285]:   <uuid>5be87410-64d6-43f1-b8f2-70ace93f90ce</uuid>
Apr 13 20:28:16 user nova-compute[71285]:   <name>instance-00000017</name>
Apr 13 20:28:16 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:28:16 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:28:16 user nova-compute[71285]:   <metadata>
Apr 13 20:28:16 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:28:16 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:name>tempest-TestMinimumBasicScenario-server-2066526535</nova:name>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:28:16</nova:creationTime>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:28:16 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:28:16 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:owner>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:user uuid="519afe2b763347ea889f7de8773d7de0">tempest-TestMinimumBasicScenario-1286218256-project-member</nova:user>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:project uuid="41f1e999778042e2a606a2ae4072bc83">tempest-TestMinimumBasicScenario-1286218256</nova:project>
Apr 13 20:28:16 user nova-compute[71285]:       </nova:owner>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:root type="image" uuid="54a85f0f-585c-4c38-b211-c4a8d01d6811"/>
Apr 13 20:28:16 user nova-compute[71285]:       <nova:ports>
Apr 13 20:28:16 user nova-compute[71285]:         <nova:port uuid="616b4969-2bbc-47cf-ac86-236d2fb36468">
Apr 13 20:28:16 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:28:16 user nova-compute[71285]:         </nova:port>
Apr 13 20:28:16 user nova-compute[71285]:       </nova:ports>
Apr 13 20:28:16 user nova-compute[71285]:     </nova:instance>
Apr 13 20:28:16 user nova-compute[71285]:   </metadata>
Apr 13 20:28:16 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:28:16 user nova-compute[71285]:     <system>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="serial">5be87410-64d6-43f1-b8f2-70ace93f90ce</entry>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="uuid">5be87410-64d6-43f1-b8f2-70ace93f90ce</entry>
Apr 13 20:28:16 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:28:16 user nova-compute[71285]:     </system>
Apr 13 20:28:16 user nova-compute[71285]:   </sysinfo>
Apr 13 20:28:16 user nova-compute[71285]:   <os>
Apr 13 20:28:16 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:28:16 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:28:16 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:28:16 user nova-compute[71285]:   </os>
Apr 13 20:28:16 user nova-compute[71285]:   <features>
Apr 13 20:28:16 user nova-compute[71285]:     <acpi/>
Apr 13 20:28:16 user nova-compute[71285]:     <apic/>
Apr 13 20:28:16 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:28:16 user nova-compute[71285]:   </features>
Apr 13 20:28:16 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:28:16 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:28:16 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:28:16 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:28:16 user nova-compute[71285]:   </clock>
Apr 13 20:28:16 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:28:16 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:28:16 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:28:16 user nova-compute[71285]:   </cpu>
Apr 13 20:28:16 user nova-compute[71285]:   <devices>
Apr 13 20:28:16 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:28:16 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:28:16 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk"/>
Apr 13 20:28:16 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:28:16 user nova-compute[71285]:     </disk>
Apr 13 20:28:16 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:28:16 user nova-compute[71285]:       <mac address="fa:16:3e:45:30:60"/>
Apr 13 20:28:16 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:16 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:28:16 user nova-compute[71285]:       <target dev="tap616b4969-2b"/>
Apr 13 20:28:16 user nova-compute[71285]:     </interface>
Apr 13 20:28:16 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:28:16 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/console.log" append="off"/>
Apr 13 20:28:16 user nova-compute[71285]:     </serial>
Apr 13 20:28:16 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:28:16 user nova-compute[71285]:     <video>
Apr 13 20:28:16 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:16 user nova-compute[71285]:     </video>
Apr 13 20:28:16 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:28:16 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:28:16 user nova-compute[71285]:     </rng>
Apr 13 20:28:16 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:28:16 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:28:16 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:28:16 user nova-compute[71285]:     </memballoon>
Apr 13 20:28:16 user nova-compute[71285]:   </devices>
Apr 13 20:28:16 user nova-compute[71285]: </domain>
Apr 13 20:28:16 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:28:14Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG os_vif [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap616b4969-2b, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap616b4969-2b, col_values=(('external_ids', {'iface-id': '616b4969-2bbc-47cf-ac86-236d2fb36468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:30:60', 'vm-uuid': '5be87410-64d6-43f1-b8f2-70ace93f90ce'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:16 user nova-compute[71285]: INFO os_vif [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b')
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No VIF found with MAC fa:16:3e:45:30:60, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updated VIF entry in instance network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0348b16b-d686-4c0c-8d92-812fc38cb51d req-631e02c1-6b44-4938-9de4-ca651aef55e3 service nova] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:17 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Snapshot image upload complete
Apr 13 20:28:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:17 user nova-compute[71285]: INFO nova.compute.manager [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Shelve offloading
Apr 13 20:28:17 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance destroyed successfully.
Apr 13 20:28:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:18 user nova-compute[71285]: WARNING nova.compute.manager [req-ec642695-2b6e-4a8d-8bfc-e5ea07a7f4b7 req-4e5dadd4-e4d4-4ccb-906f-63f220f37c2f service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state building and task_state spawning.
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance destroyed successfully.
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'resources' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bjG5pVyew1iMJGqVQAxyEL2SLVPg9WtjkR2GAHwrOAtXUXLy5O5gyuSVZRjngyh7gzHwecvMgf5lTzLtkHEU+E+Li7QlCYySw1RXDYaRvTOjrN0y1RquDWwlSaxchVw==',key_name='tempest-keypair-103925243',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:28:17.258359',shelved_host='user',shelved_image_id='5c9eb3d5-c65d-4892-b43b-7f09d9c4388d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:28:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG os_vif [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa573f361-5e, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:28:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:18 user nova-compute[71285]: INFO os_vif [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e')
Apr 13 20:28:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Deleting instance files /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962_del
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Deletion of /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962_del complete
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Deleted allocations for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962
Apr 13 20:28:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0746ee9a-7ad6-4451-8429-8c8f65f69148 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.576s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417699.7792263, 5be87410-64d6-43f1-b8f2-70ace93f90ce => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] VM Resumed (Lifecycle Event)
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance spawned successfully.
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417699.7804122, 5be87410-64d6-43f1-b8f2-70ace93f90ce => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] VM Started (Lifecycle Event)
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417684.9437332, 24a4358f-82a4-408d-8206-49f05579b45e => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] VM Stopped (Lifecycle Event)
Apr 13 20:28:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8629833d-19e9-4a00-8989-0a6633f75bdb None None] [instance: 24a4358f-82a4-408d-8206-49f05579b45e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:19 user nova-compute[71285]: INFO nova.compute.manager [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Took 6.50 seconds to build instance.
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-856824ba-d334-4f76-8879-3b597b1728eb tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.598s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:20 user nova-compute[71285]: INFO nova.compute.manager [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Rescuing
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:20 user nova-compute[71285]: WARNING nova.compute.manager [req-890dfb45-7e0c-4a0b-830c-b2c1e54c3536 req-08e46a65-2fd3-4265-8933-208ca816165d service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state active and task_state None.
Apr 13 20:28:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance destroyed successfully.
Apr 13 20:28:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Attempting rescue
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:28:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Creating image(s)
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue" returned: 0 in 0.048s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start _get_guest_xml network_info=[{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:98:81:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'numa_topology' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1930901382',display_name='tempest-ServerRescueNegativeTestJSON-server-1930901382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1930901382',id=15,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:23:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-dkdzfdu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:23:48Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=00d20026-e9af-4587-8930-d3dcfdb1ea3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:98:81:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:98:81:3c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:28:21 user nova-compute[71285]:   <uuid>00d20026-e9af-4587-8930-d3dcfdb1ea3e</uuid>
Apr 13 20:28:21 user nova-compute[71285]:   <name>instance-0000000f</name>
Apr 13 20:28:21 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:28:21 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:28:21 user nova-compute[71285]:   <metadata>
Apr 13 20:28:21 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:28:21 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1930901382</nova:name>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:28:21</nova:creationTime>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:28:21 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:28:21 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:owner>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:28:21 user nova-compute[71285]:       </nova:owner>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:28:21 user nova-compute[71285]:       <nova:ports>
Apr 13 20:28:21 user nova-compute[71285]:         <nova:port uuid="374f6442-f0a3-4801-a43f-4566b1aec40b">
Apr 13 20:28:21 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 20:28:21 user nova-compute[71285]:         </nova:port>
Apr 13 20:28:21 user nova-compute[71285]:       </nova:ports>
Apr 13 20:28:21 user nova-compute[71285]:     </nova:instance>
Apr 13 20:28:21 user nova-compute[71285]:   </metadata>
Apr 13 20:28:21 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:28:21 user nova-compute[71285]:     <system>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="serial">00d20026-e9af-4587-8930-d3dcfdb1ea3e</entry>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="uuid">00d20026-e9af-4587-8930-d3dcfdb1ea3e</entry>
Apr 13 20:28:21 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:28:21 user nova-compute[71285]:     </system>
Apr 13 20:28:21 user nova-compute[71285]:   </sysinfo>
Apr 13 20:28:21 user nova-compute[71285]:   <os>
Apr 13 20:28:21 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:28:21 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:28:21 user nova-compute[71285]:   </os>
Apr 13 20:28:21 user nova-compute[71285]:   <features>
Apr 13 20:28:21 user nova-compute[71285]:     <acpi/>
Apr 13 20:28:21 user nova-compute[71285]:     <apic/>
Apr 13 20:28:21 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:28:21 user nova-compute[71285]:   </features>
Apr 13 20:28:21 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:28:21 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:28:21 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:28:21 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:28:21 user nova-compute[71285]:   </clock>
Apr 13 20:28:21 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:28:21 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:28:21 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:28:21 user nova-compute[71285]:   </cpu>
Apr 13 20:28:21 user nova-compute[71285]:   <devices>
Apr 13 20:28:21 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:28:21 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:28:21 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue"/>
Apr 13 20:28:21 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:28:21 user nova-compute[71285]:     </disk>
Apr 13 20:28:21 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:28:21 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:28:21 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk"/>
Apr 13 20:28:21 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:28:21 user nova-compute[71285]:     </disk>
Apr 13 20:28:21 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:28:21 user nova-compute[71285]:       <mac address="fa:16:3e:98:81:3c"/>
Apr 13 20:28:21 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:21 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:28:21 user nova-compute[71285]:       <target dev="tap374f6442-f0"/>
Apr 13 20:28:21 user nova-compute[71285]:     </interface>
Apr 13 20:28:21 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:28:21 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/console.log" append="off"/>
Apr 13 20:28:21 user nova-compute[71285]:     </serial>
Apr 13 20:28:21 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:28:21 user nova-compute[71285]:     <video>
Apr 13 20:28:21 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:28:21 user nova-compute[71285]:     </video>
Apr 13 20:28:21 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:28:21 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:28:21 user nova-compute[71285]:     </rng>
Apr 13 20:28:21 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:28:21 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:28:21 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:28:21 user nova-compute[71285]:     </memballoon>
Apr 13 20:28:21 user nova-compute[71285]:   </devices>
Apr 13 20:28:21 user nova-compute[71285]: </domain>
Apr 13 20:28:21 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:28:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance destroyed successfully.
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:28:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:98:81:3c, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:22 user nova-compute[71285]: WARNING nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state active and task_state rescuing.
Apr 13 20:28:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:22 user nova-compute[71285]: WARNING nova.compute.manager [req-206c7c91-3cc8-4401-a58d-ef7b7dccdffe req-2d87ffb7-6871-42e7-abad-b08766e3d8ae service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state active and task_state rescuing.
Apr 13 20:28:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:24 user nova-compute[71285]: WARNING nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state active and task_state rescuing.
Apr 13 20:28:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:28:24 user nova-compute[71285]: WARNING nova.compute.manager [req-74d736f2-d385-4e33-abcd-e09b860eeb29 req-884e15e7-ea1b-4713-84d3-c5364485a0d1 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state active and task_state rescuing.
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 00d20026-e9af-4587-8930-d3dcfdb1ea3e due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417705.4924176, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Resumed (Lifecycle Event)
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c1b660c2-277d-4f38-88b2-9a3b30caa615 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417705.5011826, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Started (Lifecycle Event)
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:28:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:28 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417693.7368386, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:28:28 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Stopped (Lifecycle Event)
Apr 13 20:28:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-100d4d1d-be51-4c50-805b-9e3be31202be None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:28:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:28:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:28:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:52 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:52 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=26.344345092773438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a369e185-3d75-4dde-8e8a-0e397aab892b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:28:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:28:56 user nova-compute[71285]: INFO nova.compute.manager [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Detaching volume c609f609-6cab-47d1-85eb-bf8ad9a0a959
Apr 13 20:28:56 user nova-compute[71285]: INFO nova.virt.block_device [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Attempting to driver detach volume c609f609-6cab-47d1-85eb-bf8ad9a0a959 from mountpoint /dev/vdb
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Attempting to detach device vdb from instance a369e185-3d75-4dde-8e8a-0e397aab892b from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:28:56 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:28:56 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:28:56 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:28:56 user nova-compute[71285]:   <serial>c609f609-6cab-47d1-85eb-bf8ad9a0a959</serial>
Apr 13 20:28:56 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:28:56 user nova-compute[71285]: </disk>
Apr 13 20:28:56 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:28:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance a369e185-3d75-4dde-8e8a-0e397aab892b from the persistent domain config.
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a369e185-3d75-4dde-8e8a-0e397aab892b from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:28:56 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:28:56 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:28:56 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:28:56 user nova-compute[71285]:   <serial>c609f609-6cab-47d1-85eb-bf8ad9a0a959</serial>
Apr 13 20:28:56 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:28:56 user nova-compute[71285]: </disk>
Apr 13 20:28:56 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417736.7041602, a369e185-3d75-4dde-8e8a-0e397aab892b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:28:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance a369e185-3d75-4dde-8e8a-0e397aab892b from the live domain config.
Apr 13 20:28:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uteEqXsw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:28:56 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[925f9497-2fc5-4fd8-94c4-b47f8449bfab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:28:56 user nova-compute[71285]: No targets found.
Apr 13 20:28:56 user nova-compute[71285]: iSNS:
Apr 13 20:28:56 user nova-compute[71285]: No targets found.
Apr 13 20:28:56 user nova-compute[71285]: STATIC:
Apr 13 20:28:56 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959
Apr 13 20:28:56 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:28:56 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:28:56 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:28:56 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:28:56 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:28:56 user nova-compute[71285]: FIRMWARE:
Apr 13 20:28:56 user nova-compute[71285]: No targets found.
Apr 13 20:28:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:28:56 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:28:56 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db933039-e4e3-4f70-b440-f9307e282f50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cbe8c4-f59b-4662-8709-6ec84cb6e194]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:56 user nova-compute[71285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:28:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 (non-flash)
Apr 13 20:28:56 user nova-compute[71285]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:28:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc643eab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e23fa5-de5a-46fe-9063-ea49d128e040]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[efceb0d4-2a7a-4de8-8cbf-0c6a3a85a128]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf072be-fa86-4b3c-bc89-9b54dace9c82]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae5cbff-0a68-4084-9aea-af617783272f]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25f6cc6-2a64-49e9-9269-0c8af54be1fb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3913772-7d30-4e52-8203-b3c79c4c3853]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260]
Apr 13 20:28:56 user nova-compute[71285]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959, portal: 172.16.0.220,3260] successful.
Apr 13 20:28:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c609f609-6cab-47d1-85eb-bf8ad9a0a959 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[697f7271-329b-419d-8d1f-aa731de54c9d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== disconnect_volume: return (294ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:28:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ebc17ce-2101-41d3-9ce4-39086acdbb56 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.793s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:28:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:28:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:29:05 user nova-compute[71285]: INFO nova.compute.claims [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Claim successful on node user
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:29:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:29:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:29:06 user nova-compute[71285]: INFO nova.virt.block_device [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Booting with volume snapshot bec4620f-ff7e-4c6f-b44a-c5794c41cdb8 at /dev/vda
Apr 13 20:29:06 user nova-compute[71285]: DEBUG nova.policy [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:29:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Successfully created port: 7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Successfully updated port: 7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-changed-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Refreshing instance network info cache due to event network-changed-7a7478fd-2933-48b0-acdb-1bab32cefd46. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:29:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Acquiring lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updating instance_info_cache with network_info: [{"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Instance network_info: |[{"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Acquired lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Refreshing network info cache for port 7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updated VIF entry in instance network info cache for port 7a7478fd-2933-48b0-acdb-1bab32cefd46. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updating instance_info_cache with network_info: [{"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-85881515-e6e9-4ec6-a7c0-95596a82638e req-785a9f53-5378-4cf1-9807-3cbae81cbaae service nova] Releasing lock "refresh_cache-ee274ffc-0455-4733-8a69-33f1210ed781" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:29:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.utils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bdf80e-272f-451b-b90b-df54353aa425]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f9d37-3933-40a2-8c2c-70c2329b8f15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce25ad4-4c1e-47a1-9e7e-40f978476782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cc9425-265f-4999-89d0-d6971e25f17c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:29:11 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:29:11 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba94c32f-4233-4019-9abe-12f809392288]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG os_brick.utils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:29:11 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updating existing volume attachment record: f9033ee5-aa5f-4c62-97e6-5d7ffad7c657 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:29:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:29:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Creating image(s)
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Ensure instance console log exists: /opt/stack/data/nova/instances/ee274ffc-0455-4733-8a69-33f1210ed781/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Start _get_guest_xml network_info=[{"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewJTsAgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee274ffc-0455-4733-8a69-33f1210ed781', 'attached_at': '', 'detached_at': '', 'volume_id': '2b483629-6280-4749-ad86-af9b6a9a5dcc', 'serial': '2b483629-6280-4749-ad86-af9b6a9a5dcc'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'f9033ee5-aa5f-4c62-97e6-5d7ffad7c657', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:29:16 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:16 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewJTsAgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:29:16 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:29:16 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:29:16 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7135035b-1445-42b0-a0c2-3722d412de5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:29:16 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[552da3ed-62f0-4f3d-8941-03df31f8f639]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc] added
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a50ef3-79c6-4993-9b7d-0a2b7c84345c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b845fe-232a-4be8-b29d-69f7a27d7e26]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewJTsAgm {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewJTsAgm" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb1967-7a3c-4c6e-8f69-a3abe83e3182]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewJTsAgm'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be71d70-b0ad-413e-8eb3-7e3abee820e6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d77561-aa01-4ad2-8642-332fa36bd8a2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bf3b9d-aed1-409b-8b12-d6ea5d54dbc7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260]
Apr 13 20:29:16 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260] successful.
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b60e67-209f-4cee-888a-89de79177e27]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade1eb6-b604-4716-9e38-0a369af58272]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:29:16 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:29:16 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:29:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d594ca7-9c01-48bb-8004-99d1b4b061aa]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:29:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewJTsAgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26435303662306361', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303662306361', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-301039361',display_name='tempest-TestVolumeBootPattern-server-301039361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-301039361',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-22phj6c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:29:06Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=ee274ffc-0455-4733-8a69-33f1210ed781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid ee274ffc-0455-4733-8a69-33f1210ed781 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:29:17 user nova-compute[71285]:   <uuid>ee274ffc-0455-4733-8a69-33f1210ed781</uuid>
Apr 13 20:29:17 user nova-compute[71285]:   <name>instance-00000018</name>
Apr 13 20:29:17 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:29:17 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:29:17 user nova-compute[71285]:   <metadata>
Apr 13 20:29:17 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:29:17 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:29:17 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-server-301039361</nova:name>
Apr 13 20:29:17 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:29:16</nova:creationTime>
Apr 13 20:29:17 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:29:17 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:29:17 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:29:17 user nova-compute[71285]:       <nova:owner>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:29:17 user nova-compute[71285]:       </nova:owner>
Apr 13 20:29:17 user nova-compute[71285]:       <nova:ports>
Apr 13 20:29:17 user nova-compute[71285]:         <nova:port uuid="7a7478fd-2933-48b0-acdb-1bab32cefd46">
Apr 13 20:29:17 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 20:29:17 user nova-compute[71285]:         </nova:port>
Apr 13 20:29:17 user nova-compute[71285]:       </nova:ports>
Apr 13 20:29:17 user nova-compute[71285]:     </nova:instance>
Apr 13 20:29:17 user nova-compute[71285]:   </metadata>
Apr 13 20:29:17 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:29:17 user nova-compute[71285]:     <system>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="serial">ee274ffc-0455-4733-8a69-33f1210ed781</entry>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="uuid">ee274ffc-0455-4733-8a69-33f1210ed781</entry>
Apr 13 20:29:17 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:29:17 user nova-compute[71285]:     </system>
Apr 13 20:29:17 user nova-compute[71285]:   </sysinfo>
Apr 13 20:29:17 user nova-compute[71285]:   <os>
Apr 13 20:29:17 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:29:17 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:29:17 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:29:17 user nova-compute[71285]:   </os>
Apr 13 20:29:17 user nova-compute[71285]:   <features>
Apr 13 20:29:17 user nova-compute[71285]:     <acpi/>
Apr 13 20:29:17 user nova-compute[71285]:     <apic/>
Apr 13 20:29:17 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:29:17 user nova-compute[71285]:   </features>
Apr 13 20:29:17 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:29:17 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:29:17 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:29:17 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:29:17 user nova-compute[71285]:   </clock>
Apr 13 20:29:17 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:29:17 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:29:17 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:29:17 user nova-compute[71285]:   </cpu>
Apr 13 20:29:17 user nova-compute[71285]:   <devices>
Apr 13 20:29:17 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:29:17 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:29:17 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:29:17 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:29:17 user nova-compute[71285]:       <serial>2b483629-6280-4749-ad86-af9b6a9a5dcc</serial>
Apr 13 20:29:17 user nova-compute[71285]:     </disk>
Apr 13 20:29:17 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:29:17 user nova-compute[71285]:       <mac address="fa:16:3e:d1:47:31"/>
Apr 13 20:29:17 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:29:17 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:29:17 user nova-compute[71285]:       <target dev="tap7a7478fd-29"/>
Apr 13 20:29:17 user nova-compute[71285]:     </interface>
Apr 13 20:29:17 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:29:17 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/ee274ffc-0455-4733-8a69-33f1210ed781/console.log" append="off"/>
Apr 13 20:29:17 user nova-compute[71285]:     </serial>
Apr 13 20:29:17 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:29:17 user nova-compute[71285]:     <video>
Apr 13 20:29:17 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:29:17 user nova-compute[71285]:     </video>
Apr 13 20:29:17 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:29:17 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:29:17 user nova-compute[71285]:     </rng>
Apr 13 20:29:17 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:29:17 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:29:17 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:29:17 user nova-compute[71285]:     </memballoon>
Apr 13 20:29:17 user nova-compute[71285]:   </devices>
Apr 13 20:29:17 user nova-compute[71285]: </domain>
Apr 13 20:29:17 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-301039361',display_name='tempest-TestVolumeBootPattern-server-301039361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-301039361',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-22phj6c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:29:06Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=ee274ffc-0455-4733-8a69-33f1210ed781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG os_vif [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a7478fd-29, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a7478fd-29, col_values=(('external_ids', {'iface-id': '7a7478fd-2933-48b0-acdb-1bab32cefd46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:47:31', 'vm-uuid': 'ee274ffc-0455-4733-8a69-33f1210ed781'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:17 user nova-compute[71285]: INFO os_vif [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29')
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:29:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:d1:47:31, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:29:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] No waiting events found dispatching network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:19 user nova-compute[71285]: WARNING nova.compute.manager [req-82c5079e-b476-4d72-a06d-55f32dbed648 req-c4f6a5b8-8761-40ab-bd43-787c859d230e service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received unexpected event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance with vm_state building and task_state spawning.
Apr 13 20:29:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417761.0204594, ee274ffc-0455-4733-8a69-33f1210ed781 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] VM Resumed (Lifecycle Event)
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Instance spawned successfully.
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417761.0243232, ee274ffc-0455-4733-8a69-33f1210ed781 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] VM Started (Lifecycle Event)
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Took 4.91 seconds to spawn the instance on the hypervisor.
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:21 user nova-compute[71285]: INFO nova.compute.manager [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Took 15.74 seconds to build instance.
Apr 13 20:29:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8844c1f8-66cb-4735-8e14-7ced792e2691 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.839s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:21 user nova-compute[71285]: DEBUG nova.compute.manager [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] No waiting events found dispatching network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:21 user nova-compute[71285]: WARNING nova.compute.manager [req-afffb90f-2e36-4e70-a77d-5d78cecbc63e req-839511a9-f53e-4a38-8c63-7c74aeea9c48 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received unexpected event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance with vm_state active and task_state None.
Apr 13 20:29:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:29:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:29:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'info_cache' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:29:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance destroyed successfully.
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'resources' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG os_vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5b9a9b4-bd, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:29:44 user nova-compute[71285]: INFO os_vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start _get_guest_xml network_info=[{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:44 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:29:44 user nova-compute[71285]:   <uuid>7d01394e-edb8-4c51-a71a-e07c0ee164db</uuid>
Apr 13 20:29:44 user nova-compute[71285]:   <name>instance-0000000c</name>
Apr 13 20:29:44 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:29:44 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:29:44 user nova-compute[71285]:   <metadata>
Apr 13 20:29:44 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:29:44 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeTestJSON-server-492449566</nova:name>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:29:44</nova:creationTime>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:29:44 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:29:44 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:owner>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:user uuid="b5210a73b1574e82838f3f0ccef93a25">tempest-AttachVolumeTestJSON-1545246928-project-member</nova:user>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:project uuid="587bca93ee3f45b9b5b1ceb91e972e7b">tempest-AttachVolumeTestJSON-1545246928</nova:project>
Apr 13 20:29:44 user nova-compute[71285]:       </nova:owner>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:29:44 user nova-compute[71285]:       <nova:ports>
Apr 13 20:29:44 user nova-compute[71285]:         <nova:port uuid="b5b9a9b4-bd38-4cfc-b483-9bae4721fb09">
Apr 13 20:29:44 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:29:44 user nova-compute[71285]:         </nova:port>
Apr 13 20:29:44 user nova-compute[71285]:       </nova:ports>
Apr 13 20:29:44 user nova-compute[71285]:     </nova:instance>
Apr 13 20:29:44 user nova-compute[71285]:   </metadata>
Apr 13 20:29:44 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:29:44 user nova-compute[71285]:     <system>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="serial">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="uuid">7d01394e-edb8-4c51-a71a-e07c0ee164db</entry>
Apr 13 20:29:44 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:29:44 user nova-compute[71285]:     </system>
Apr 13 20:29:44 user nova-compute[71285]:   </sysinfo>
Apr 13 20:29:44 user nova-compute[71285]:   <os>
Apr 13 20:29:44 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:29:44 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:29:44 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:29:44 user nova-compute[71285]:   </os>
Apr 13 20:29:44 user nova-compute[71285]:   <features>
Apr 13 20:29:44 user nova-compute[71285]:     <acpi/>
Apr 13 20:29:44 user nova-compute[71285]:     <apic/>
Apr 13 20:29:44 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:29:44 user nova-compute[71285]:   </features>
Apr 13 20:29:44 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:29:44 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:29:44 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:29:44 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:29:44 user nova-compute[71285]:   </clock>
Apr 13 20:29:44 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:29:44 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:29:44 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:29:44 user nova-compute[71285]:   </cpu>
Apr 13 20:29:44 user nova-compute[71285]:   <devices>
Apr 13 20:29:44 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:29:44 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:29:44 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk"/>
Apr 13 20:29:44 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:29:44 user nova-compute[71285]:     </disk>
Apr 13 20:29:44 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:29:44 user nova-compute[71285]:       <mac address="fa:16:3e:b8:5a:71"/>
Apr 13 20:29:44 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:29:44 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:29:44 user nova-compute[71285]:       <target dev="tapb5b9a9b4-bd"/>
Apr 13 20:29:44 user nova-compute[71285]:     </interface>
Apr 13 20:29:44 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:29:44 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/console.log" append="off"/>
Apr 13 20:29:44 user nova-compute[71285]:     </serial>
Apr 13 20:29:44 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:29:44 user nova-compute[71285]:     <video>
Apr 13 20:29:44 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:29:44 user nova-compute[71285]:     </video>
Apr 13 20:29:44 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:29:44 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:29:44 user nova-compute[71285]:     </rng>
Apr 13 20:29:44 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:29:44 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:29:44 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:29:44 user nova-compute[71285]:     </memballoon>
Apr 13 20:29:44 user nova-compute[71285]:   </devices>
Apr 13 20:29:44 user nova-compute[71285]: </domain>
Apr 13 20:29:44 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Cannot resize image /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'migration_context' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG os_vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5b9a9b4-bd, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5b9a9b4-bd, col_values=(('external_ids', {'iface-id': 'b5b9a9b4-bd38-4cfc-b483-9bae4721fb09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:5a:71', 'vm-uuid': '7d01394e-edb8-4c51-a71a-e07c0ee164db'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:29:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:44 user nova-compute[71285]: INFO os_vif [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:46 user nova-compute[71285]: WARNING nova.compute.manager [req-97f2a18d-27c5-4682-bee9-3aa3fe9508f0 req-07301bb4-592f-4329-9e27-9ffdc4be98f2 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state stopped and task_state powering-on.
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:46 user nova-compute[71285]: INFO nova.compute.manager [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Terminating instance
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-unplugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] No waiting events found dispatching network-vif-unplugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-89a96bd7-fe78-4758-8bf2-be318e8bfe2a req-ebcfb589-adf7-4d8e-9504-77efe6312665 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-unplugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Instance destroyed successfully.
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'resources' on Instance uuid a369e185-3d75-4dde-8e8a-0e397aab892b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:24:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2073344445',display_name='tempest-AttachVolumeNegativeTest-server-2073344445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2073344445',id=19,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdjoDiR1/sxa22KQXzCamjjsrRTyiAOJ2BXVbr3VKtptw//6iZxUKXiHIuassm+TSllT76mN0mTCLuZjyyqQw92kfnNawKIbveVY+nl2cPGP5yLSaDV6Jq9V6tpSU1rkQ==',key_name='tempest-keypair-460582492',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-rhn0f1tg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:24:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=a369e185-3d75-4dde-8e8a-0e397aab892b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "address": "fa:16:3e:b1:5c:98", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1c8d9d1-ab", "ovs_interfaceid": "d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG os_vif [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1c8d9d1-ab, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:29:47 user nova-compute[71285]: INFO os_vif [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:5c:98,bridge_name='br-int',has_traffic_filtering=True,id=d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1c8d9d1-ab')
Apr 13 20:29:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Deleting instance files /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b_del
Apr 13 20:29:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Deletion of /opt/stack/data/nova/instances/a369e185-3d75-4dde-8e8a-0e397aab892b_del complete
Apr 13 20:29:47 user nova-compute[71285]: INFO nova.compute.manager [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 13 20:29:47 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:29:47 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Took 0.70 seconds to deallocate network for instance.
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:48 user nova-compute[71285]: WARNING nova.compute.manager [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state stopped and task_state powering-on.
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-bc1afb0f-ed6b-45f3-9883-c741e7eb3b69 req-56ce5569-69a2-4d88-82ce-a83cd5cc82b1 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-deleted-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417788.462584, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Resumed (Lifecycle Event)
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance rebooted successfully.
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7755c8a4-9b0c-4d37-add7-8065aa0156aa tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417788.4639866, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Started (Lifecycle Event)
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:48 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Deleted allocations for instance a369e185-3d75-4dde-8e8a-0e397aab892b
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-2bb568ad-d59b-46a6-8bc0-87628e0da8f2 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.305s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Acquiring lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] Lock "a369e185-3d75-4dde-8e8a-0e397aab892b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] No waiting events found dispatching network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:29:48 user nova-compute[71285]: WARNING nova.compute.manager [req-d078b67b-2e89-4260-a767-0fe05e198918 req-4de478ab-ecb1-4e3a-944e-b2344213aee3 service nova] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Received unexpected event network-vif-plugged-d1c8d9d1-abe3-41a6-ab16-dfe4bb848a8d for instance with vm_state deleted and task_state None.
Apr 13 20:29:49 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:29:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7963MB free_disk=26.35228729248047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ee274ffc-0455-4733-8a69-33f1210ed781 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:29:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:29:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:29:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:30:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:30:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:30:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:02 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417787.3718216, a369e185-3d75-4dde-8e8a-0e397aab892b => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:02 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] VM Stopped (Lifecycle Event)
Apr 13 20:30:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2928b9b9-4919-4dd6-ae13-204947e1172f None None] [instance: a369e185-3d75-4dde-8e8a-0e397aab892b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:05 user nova-compute[71285]: INFO nova.compute.manager [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Unshelving
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:05 user nova-compute[71285]: INFO nova.compute.manager [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Attaching volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a to /dev/vdb
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_requests' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'numa_topology' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:30:05 user nova-compute[71285]: INFO nova.compute.claims [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Claim successful on node user
Apr 13 20:30:05 user nova-compute[71285]: DEBUG os_brick.utils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc1103-ea72-46c3-a695-3395557a5744]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[547edf90-5897-4a9e-abe3-649e77a6791a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f1e8eb-c1e1-47c2-a8ba-6f6be034c9e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0083d2-9be1-4acd-b43d-946cfbb2ec28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:30:06 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[73408f68-c46a-4326-9f5c-02ff716497e0]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG os_brick.utils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating existing volume attachment record: d1cfb56a-ec4b-455d-96ca-bd05df5a5380 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:06 user nova-compute[71285]: INFO nova.network.neutron [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating port a573f361-5e24-4509-aa70-50df8b98cf0d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing instance network info cache due to event network-changed-a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Acquiring lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:30:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Creating image(s)
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Acquired lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Refreshing network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "b3431100a5153f0576f6fe6945f1b566296176e3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "b3431100a5153f0576f6fe6945f1b566296176e3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.part --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG nova.virt.images [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] 5c9eb3d5-c65d-4892-b43b-7f09d9c4388d was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.part /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updated VIF entry in instance network info cache for port a573f361-5e24-4509-aa70-50df8b98cf0d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-66febf59-8f86-40dd-af0e-62f38939494e req-81eafee8-0e1f-48bd-b2ab-c75727b0d303 service nova] Releasing lock "refresh_cache-4c067bb3-5a8d-4198-9b35-bf8dc2a98962" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.part /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.converted" returned: 0 in 0.364s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "b3431100a5153f0576f6fe6945f1b566296176e3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.469s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "b3431100a5153f0576f6fe6945f1b566296176e3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "b3431100a5153f0576f6fe6945f1b566296176e3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3,backing_fmt=raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3,backing_fmt=raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk 1073741824" returned: 0 in 0.047s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "b3431100a5153f0576f6fe6945f1b566296176e3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'migration_context' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:09 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Rebasing disk image.
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:09 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 -F raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:10 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:10 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:10 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f4d1b-8163-47e0-ba65-9d737bc8c112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:30:10 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6df83-5dfc-4249-ab6f-acec21fa0a06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a] added
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528ed8c-1fe1-42fe-ac0e-b25004dda104]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa971f8-27ae-4d9d-a943-6f4d1ce48b6f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLkQrJnp {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLkQrJnp" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a72148-54fe-4107-84d7-e5cbd4bafcfd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLkQrJnp'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77e4365-2f7b-43a6-84b6-3d9bc120b60c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39f77eb-f097-4472-918b-48196d3b9088]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ba575-8dfb-4be7-b32d-c39ea6a1df1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]
Apr 13 20:30:10 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da995c5a-09da-43ef-b9e4-fee1b55132f1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aaf078-5ca1-4772-9090-fcdaa67b70c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:10 user nova-compute[71285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:10 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e0789f-54c5-42c3-bc4a-ea00e938f087]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:30:10 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:30:11 user nova-compute[71285]: INFO nova.compute.manager [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Unrescuing
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 -F raw /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk" returned: 0 in 1.977s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Ensure instance console log exists: /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start _get_guest_xml network_info=[{"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4d8a405441cb809bb82ecdaf0905a885',container_format='bare',created_at=2023-04-13T20:28:13Z,direct_url=<?>,disk_format='qcow2',id=5c9eb3d5-c65d-4892-b43b-7f09d9c4388d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1206860275-shelved',owner='405aed9fca044ab39eabe188942230d2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T20:28:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:30:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4d8a405441cb809bb82ecdaf0905a885',container_format='bare',created_at=2023-04-13T20:28:13Z,direct_url=<?>,disk_format='qcow2',id=5c9eb3d5-c65d-4892-b43b-7f09d9c4388d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1206860275-shelved',owner='405aed9fca044ab39eabe188942230d2',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-13T20:28:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='5c9eb3d5-c65d-4892-b43b-7f09d9c4388d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-103925243',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:28:17.258359',shelved_host='user',shelved_image_id='5c9eb3d5-c65d-4892-b43b-7f09d9c4388d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:30:11 user nova-compute[71285]:   <uuid>4c067bb3-5a8d-4198-9b35-bf8dc2a98962</uuid>
Apr 13 20:30:11 user nova-compute[71285]:   <name>instance-00000016</name>
Apr 13 20:30:11 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:30:11 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:30:11 user nova-compute[71285]:   <metadata>
Apr 13 20:30:11 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:30:11 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1206860275</nova:name>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:30:11</nova:creationTime>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:30:11 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:30:11 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:owner>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:user uuid="36e11efc98604eb7a8d5b95563431e45">tempest-AttachVolumeShelveTestJSON-160294736-project-member</nova:user>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:project uuid="405aed9fca044ab39eabe188942230d2">tempest-AttachVolumeShelveTestJSON-160294736</nova:project>
Apr 13 20:30:11 user nova-compute[71285]:       </nova:owner>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:root type="image" uuid="5c9eb3d5-c65d-4892-b43b-7f09d9c4388d"/>
Apr 13 20:30:11 user nova-compute[71285]:       <nova:ports>
Apr 13 20:30:11 user nova-compute[71285]:         <nova:port uuid="a573f361-5e24-4509-aa70-50df8b98cf0d">
Apr 13 20:30:11 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 20:30:11 user nova-compute[71285]:         </nova:port>
Apr 13 20:30:11 user nova-compute[71285]:       </nova:ports>
Apr 13 20:30:11 user nova-compute[71285]:     </nova:instance>
Apr 13 20:30:11 user nova-compute[71285]:   </metadata>
Apr 13 20:30:11 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:30:11 user nova-compute[71285]:     <system>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="serial">4c067bb3-5a8d-4198-9b35-bf8dc2a98962</entry>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="uuid">4c067bb3-5a8d-4198-9b35-bf8dc2a98962</entry>
Apr 13 20:30:11 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:30:11 user nova-compute[71285]:     </system>
Apr 13 20:30:11 user nova-compute[71285]:   </sysinfo>
Apr 13 20:30:11 user nova-compute[71285]:   <os>
Apr 13 20:30:11 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:30:11 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:30:11 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:30:11 user nova-compute[71285]:   </os>
Apr 13 20:30:11 user nova-compute[71285]:   <features>
Apr 13 20:30:11 user nova-compute[71285]:     <acpi/>
Apr 13 20:30:11 user nova-compute[71285]:     <apic/>
Apr 13 20:30:11 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:30:11 user nova-compute[71285]:   </features>
Apr 13 20:30:11 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:30:11 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:30:11 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:30:11 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:30:11 user nova-compute[71285]:   </clock>
Apr 13 20:30:11 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:30:11 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:30:11 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:30:11 user nova-compute[71285]:   </cpu>
Apr 13 20:30:11 user nova-compute[71285]:   <devices>
Apr 13 20:30:11 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:30:11 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:30:11 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk"/>
Apr 13 20:30:11 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:30:11 user nova-compute[71285]:     </disk>
Apr 13 20:30:11 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:30:11 user nova-compute[71285]:       <mac address="fa:16:3e:e3:4d:81"/>
Apr 13 20:30:11 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:11 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:30:11 user nova-compute[71285]:       <target dev="tapa573f361-5e"/>
Apr 13 20:30:11 user nova-compute[71285]:     </interface>
Apr 13 20:30:11 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:30:11 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/console.log" append="off"/>
Apr 13 20:30:11 user nova-compute[71285]:     </serial>
Apr 13 20:30:11 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:30:11 user nova-compute[71285]:     <video>
Apr 13 20:30:11 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:11 user nova-compute[71285]:     </video>
Apr 13 20:30:11 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:30:11 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:30:11 user nova-compute[71285]:     </rng>
Apr 13 20:30:11 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:30:11 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:30:11 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:30:11 user nova-compute[71285]:     </memballoon>
Apr 13 20:30:11 user nova-compute[71285]:   </devices>
Apr 13 20:30:11 user nova-compute[71285]: </domain>
Apr 13 20:30:11 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='5c9eb3d5-c65d-4892-b43b-7f09d9c4388d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-103925243',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member',shelved_at='2023-04-13T20:28:17.258359',shelved_host='user',shelved_image_id='5c9eb3d5-c65d-4892-b43b-7f09d9c4388d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:30:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG os_vif [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa573f361-5e, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa573f361-5e, col_values=(('external_ids', {'iface-id': 'a573f361-5e24-4509-aa70-50df8b98cf0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:4d:81', 'vm-uuid': '4c067bb3-5a8d-4198-9b35-bf8dc2a98962'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: INFO os_vif [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e')
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] No VIF found with MAC fa:16:3e:e3:4d:81, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23532646136633465', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532646136633465', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:30:11 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:30:11 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:30:11 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:30:11 user nova-compute[71285]:   <serial>80e647b5-ac5e-491b-acfc-32f350f2cc4a</serial>
Apr 13 20:30:11 user nova-compute[71285]: </disk>
Apr 13 20:30:11 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:12 user nova-compute[71285]: WARNING nova.compute.manager [req-0c0650db-8997-426d-b136-998af1136a87 req-4f5a1767-dbc0-44d5-8b8b-d6d6670c617c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:30:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:13 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance destroyed successfully.
Apr 13 20:30:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No VIF found with MAC fa:16:3e:45:30:60, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-47e7e2f4-a941-4561-a866-25733867a77d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.706s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:14 user nova-compute[71285]: WARNING nova.compute.manager [req-686c5669-e8d8-4bfe-b4f9-96b74bdc5b15 req-a23e55bc-482a-4d87-aa1d-dca75035dbbc service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:30:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:14 user nova-compute[71285]: WARNING nova.compute.manager [req-472c1a75-72aa-495b-b66b-a6d3c58c79a3 req-66f90d2a-2712-490a-b137-dfcaae9a280c service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:30:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:16 user nova-compute[71285]: WARNING nova.compute.manager [req-6aa69489-5fa7-4bbf-b903-a967c2571257 req-8e799729-4240-4f8b-a283-20f33bdd1402 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:16 user nova-compute[71285]: WARNING nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:16 user nova-compute[71285]: WARNING nova.compute.manager [req-a74fe5d7-3834-415a-9a4f-4e1fc4754aa6 req-3b3a2745-3d61-4650-ae09-b49d555bf5a7 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:30:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417817.1029475, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Resumed (Lifecycle Event)
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance spawned successfully.
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417817.1074047, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Started (Lifecycle Event)
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3baf878c-4bdc-4196-905f-4c16e6ca6c79 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.648s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0a1f4a58-b3ec-4955-a562-2ceb65365a84 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 00d20026-e9af-4587-8930-d3dcfdb1ea3e due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417817.6281621, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Resumed (Lifecycle Event)
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417817.6284971, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:17 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Started (Lifecycle Event)
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing instance network info cache due to event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:30:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:30:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updated VIF entry in instance network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:30:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7682f675-fa96-44b1-8c06-f24ee2c8c7ad req-bd618056-833a-4126-ac76-550dec3c37b8 service nova] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing instance network info cache due to event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:30:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:20 user nova-compute[71285]: DEBUG nova.network.neutron [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:30:21 user nova-compute[71285]: DEBUG nova.network.neutron [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updated VIF entry in instance network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:30:21 user nova-compute[71285]: DEBUG nova.network.neutron [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a10ff08b-ce62-4e7b-b7ee-19ad5759098e req-b84fec31-e161-470b-81be-ec77bcd105e8 service nova] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:23 user nova-compute[71285]: INFO nova.compute.manager [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Rebooting instance
Apr 13 20:30:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:24 user nova-compute[71285]: WARNING nova.compute.manager [req-0c47d194-32c4-4abe-a991-5914950507f7 req-9e944ae6-e803-49da-a03d-658f61146754 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 20:30:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance destroyed successfully.
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'resources' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:24Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap616b4969-2b, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:30:24 user nova-compute[71285]: INFO os_vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b')
Apr 13 20:30:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:24 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3af3ff9-965f-4eb4-b990-40ffb7943610]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:30:24 user nova-compute[71285]: No targets found.
Apr 13 20:30:24 user nova-compute[71285]: iSNS:
Apr 13 20:30:24 user nova-compute[71285]: No targets found.
Apr 13 20:30:24 user nova-compute[71285]: STATIC:
Apr 13 20:30:24 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a
Apr 13 20:30:24 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:24 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:24 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc
Apr 13 20:30:24 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:24 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:24 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:30:24 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:24 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:24 user nova-compute[71285]: FIRMWARE:
Apr 13 20:30:24 user nova-compute[71285]: No targets found.
Apr 13 20:30:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:30:24 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:30:24 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93206ee-31eb-4ac2-b6bd-2d7e51693863]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe67e35-53e1-4685-a18e-b3c320dcb72c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:24 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:24 user nova-compute[71285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:24 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:24 user nova-compute[71285]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a381f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cf38d1-1387-40a8-81e4-c4ea0973d0ca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c18740-639b-4928-b260-6be8deb0b764]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b25a18-1fe2-4ca3-9e2b-19891fe19a25]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba4ed2-26f8-478f-a70f-b380271f1606]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cd8279-87aa-485e-a675-8ae1adb25194]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f2ce8b-d4bb-464f-9e47-f348d94bf538]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]
Apr 13 20:30:25 user nova-compute[71285]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dfa8bb-81ac-4b74-95f9-346fcc9a1860]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== disconnect_volume: return (298ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start _get_guest_xml network_info=[{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=54a85f0f-585c-4c38-b211-c4a8d01d6811,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '54a85f0f-585c-4c38-b211-c4a8d01d6811'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5be87410-64d6-43f1-b8f2-70ace93f90ce', 'attached_at': '', 'detached_at': '', 'volume_id': '80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'serial': '80e647b5-ac5e-491b-acfc-32f350f2cc4a'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'd1cfb56a-ec4b-455d-96ca-bd05df5a5380', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:30:25 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:25 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=54a85f0f-585c-4c38-b211-c4a8d01d6811,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:25 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:25 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e11ed-b2c3-4b6b-bdd1-20a6c4112565]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:30:25 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9a4b7c-7b63-48a1-8ab1-176fbdd9e5fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a] added
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c28f295-d4b3-4a6a-b5fe-d84191becb3d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfc47a-8044-41e7-9e63-3386575a02c2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLkQrJnp {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RLkQrJnp" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f14789-53bd-4efb-a374-b0afc7ae5078]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RLkQrJnp'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[022bace6-6f2e-4867-9f16-cfae609dc670]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1013a7-8644-42ac-b7d8-b391fea05ef7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[855ad521-1129-4cab-9e7c-80b0e508b681]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]
Apr 13 20:30:25 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b912d4-ac03-41b3-a908-fd3bd811c057]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb725d-5ed8-43ea-b91a-15115afbb5f7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:25 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:25 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5f0765-f746-4d82-b937-5f776807d998]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:30:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:26 user nova-compute[71285]: WARNING nova.compute.manager [req-00a4b240-9a66-41a1-9488-65e6116d783a req-7b140e75-1026-477a-ac46-e52b147e2578 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 20:30:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23532646136633465', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532646136633465', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:24Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'pci_devices' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:30:26 user nova-compute[71285]:   <uuid>5be87410-64d6-43f1-b8f2-70ace93f90ce</uuid>
Apr 13 20:30:26 user nova-compute[71285]:   <name>instance-00000017</name>
Apr 13 20:30:26 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:30:26 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:30:26 user nova-compute[71285]:   <metadata>
Apr 13 20:30:26 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:30:26 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:name>tempest-TestMinimumBasicScenario-server-2066526535</nova:name>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:30:25</nova:creationTime>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:30:26 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:30:26 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:owner>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:user uuid="519afe2b763347ea889f7de8773d7de0">tempest-TestMinimumBasicScenario-1286218256-project-member</nova:user>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:project uuid="41f1e999778042e2a606a2ae4072bc83">tempest-TestMinimumBasicScenario-1286218256</nova:project>
Apr 13 20:30:26 user nova-compute[71285]:       </nova:owner>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:root type="image" uuid="54a85f0f-585c-4c38-b211-c4a8d01d6811"/>
Apr 13 20:30:26 user nova-compute[71285]:       <nova:ports>
Apr 13 20:30:26 user nova-compute[71285]:         <nova:port uuid="616b4969-2bbc-47cf-ac86-236d2fb36468">
Apr 13 20:30:26 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:30:26 user nova-compute[71285]:         </nova:port>
Apr 13 20:30:26 user nova-compute[71285]:       </nova:ports>
Apr 13 20:30:26 user nova-compute[71285]:     </nova:instance>
Apr 13 20:30:26 user nova-compute[71285]:   </metadata>
Apr 13 20:30:26 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:30:26 user nova-compute[71285]:     <system>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="serial">5be87410-64d6-43f1-b8f2-70ace93f90ce</entry>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="uuid">5be87410-64d6-43f1-b8f2-70ace93f90ce</entry>
Apr 13 20:30:26 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:30:26 user nova-compute[71285]:     </system>
Apr 13 20:30:26 user nova-compute[71285]:   </sysinfo>
Apr 13 20:30:26 user nova-compute[71285]:   <os>
Apr 13 20:30:26 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:30:26 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:30:26 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:30:26 user nova-compute[71285]:   </os>
Apr 13 20:30:26 user nova-compute[71285]:   <features>
Apr 13 20:30:26 user nova-compute[71285]:     <acpi/>
Apr 13 20:30:26 user nova-compute[71285]:     <apic/>
Apr 13 20:30:26 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:30:26 user nova-compute[71285]:   </features>
Apr 13 20:30:26 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:30:26 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:30:26 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:30:26 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:30:26 user nova-compute[71285]:   </clock>
Apr 13 20:30:26 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:30:26 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:30:26 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:30:26 user nova-compute[71285]:   </cpu>
Apr 13 20:30:26 user nova-compute[71285]:   <devices>
Apr 13 20:30:26 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:30:26 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:30:26 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk"/>
Apr 13 20:30:26 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:30:26 user nova-compute[71285]:     </disk>
Apr 13 20:30:26 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:30:26 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:30:26 user nova-compute[71285]:       <source dev="/dev/sdd"/>
Apr 13 20:30:26 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:30:26 user nova-compute[71285]:       <serial>80e647b5-ac5e-491b-acfc-32f350f2cc4a</serial>
Apr 13 20:30:26 user nova-compute[71285]:     </disk>
Apr 13 20:30:26 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:30:26 user nova-compute[71285]:       <mac address="fa:16:3e:45:30:60"/>
Apr 13 20:30:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:26 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:30:26 user nova-compute[71285]:       <target dev="tap616b4969-2b"/>
Apr 13 20:30:26 user nova-compute[71285]:     </interface>
Apr 13 20:30:26 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:30:26 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/console.log" append="off"/>
Apr 13 20:30:26 user nova-compute[71285]:     </serial>
Apr 13 20:30:26 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:30:26 user nova-compute[71285]:     <video>
Apr 13 20:30:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:26 user nova-compute[71285]:     </video>
Apr 13 20:30:26 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:30:26 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:30:26 user nova-compute[71285]:     </rng>
Apr 13 20:30:26 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:30:26 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:30:26 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:30:26 user nova-compute[71285]:     </memballoon>
Apr 13 20:30:26 user nova-compute[71285]:   </devices>
Apr 13 20:30:26 user nova-compute[71285]: </domain>
Apr 13 20:30:26 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:30:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Cannot resize image /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'migration_context' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:30:24Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG os_vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap616b4969-2b, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap616b4969-2b, col_values=(('external_ids', {'iface-id': '616b4969-2bbc-47cf-ac86-236d2fb36468', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:30:60', 'vm-uuid': '5be87410-64d6-43f1-b8f2-70ace93f90ce'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:30:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:27 user nova-compute[71285]: INFO os_vif [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b')
Apr 13 20:30:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:28 user nova-compute[71285]: WARNING nova.compute.manager [req-be008f56-b0ec-4343-8513-261882b19c5f req-23e1f12f-1c31-4fd0-9383-ee06de71665c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 20:30:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:30 user nova-compute[71285]: WARNING nova.compute.manager [req-5c1c179a-f3d1-4ab2-8982-0cd76e95abe9 req-7655884b-d1e6-4d7f-b2da-064fbec3b2c3 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state active and task_state reboot_started_hard.
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 5be87410-64d6-43f1-b8f2-70ace93f90ce due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417830.7839746, 5be87410-64d6-43f1-b8f2-70ace93f90ce => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] VM Resumed (Lifecycle Event)
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:30:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance rebooted successfully.
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417830.7857256, 5be87410-64d6-43f1-b8f2-70ace93f90ce => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] VM Started (Lifecycle Event)
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0614d6a-246e-4f4e-91f6-6b84841be15b tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.439s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:30:40 user nova-compute[71285]: INFO nova.compute.claims [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Claim successful on node user
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:30:40 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.policy [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:30:40 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Creating image(s)
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "/opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk 1073741824" returned: 0 in 0.051s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Successfully created port: e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Cannot resize image /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'migration_context' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Ensure instance console log exists: /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Successfully updated port: e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquired lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-changed-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Refreshing instance network info cache due to event network-changed-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Acquiring lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating instance_info_cache with network_info: [{"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Releasing lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Instance network_info: |[{"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Acquired lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Refreshing network info cache for port e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Start _get_guest_xml network_info=[{"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:30:42 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:42 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:30:42 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-33634037',display_name='tempest-AttachVolumeNegativeTest-server-33634037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-33634037',id=25,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCCX8u6zrg58hMYOqDCcBgm5ASAk29l64hwlQHGPn9hPSMp9xxNJqil1FLSEZAMwckiBv6hluknAtYjB8bLkAob+IHrbZEf2TIRzSS4TuOzVhrYWPg4XCtNFAg2iOzRag==',key_name='tempest-keypair-867771061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-kyia0z09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=8acd3c03-8835-4b69-aabd-7a5a34b910d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'pci_devices' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:30:43 user nova-compute[71285]:   <uuid>8acd3c03-8835-4b69-aabd-7a5a34b910d5</uuid>
Apr 13 20:30:43 user nova-compute[71285]:   <name>instance-00000019</name>
Apr 13 20:30:43 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:30:43 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:30:43 user nova-compute[71285]:   <metadata>
Apr 13 20:30:43 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:30:43 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-33634037</nova:name>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:30:42</nova:creationTime>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:30:43 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:30:43 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:owner>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:user uuid="49383d6f0e7141548370d8bc3b96dfd9">tempest-AttachVolumeNegativeTest-1371087403-project-member</nova:user>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:project uuid="053f656470d94d2a9140f393bad01000">tempest-AttachVolumeNegativeTest-1371087403</nova:project>
Apr 13 20:30:43 user nova-compute[71285]:       </nova:owner>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:30:43 user nova-compute[71285]:       <nova:ports>
Apr 13 20:30:43 user nova-compute[71285]:         <nova:port uuid="e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b">
Apr 13 20:30:43 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:30:43 user nova-compute[71285]:         </nova:port>
Apr 13 20:30:43 user nova-compute[71285]:       </nova:ports>
Apr 13 20:30:43 user nova-compute[71285]:     </nova:instance>
Apr 13 20:30:43 user nova-compute[71285]:   </metadata>
Apr 13 20:30:43 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:30:43 user nova-compute[71285]:     <system>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="serial">8acd3c03-8835-4b69-aabd-7a5a34b910d5</entry>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="uuid">8acd3c03-8835-4b69-aabd-7a5a34b910d5</entry>
Apr 13 20:30:43 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:30:43 user nova-compute[71285]:     </system>
Apr 13 20:30:43 user nova-compute[71285]:   </sysinfo>
Apr 13 20:30:43 user nova-compute[71285]:   <os>
Apr 13 20:30:43 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:30:43 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:30:43 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:30:43 user nova-compute[71285]:   </os>
Apr 13 20:30:43 user nova-compute[71285]:   <features>
Apr 13 20:30:43 user nova-compute[71285]:     <acpi/>
Apr 13 20:30:43 user nova-compute[71285]:     <apic/>
Apr 13 20:30:43 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:30:43 user nova-compute[71285]:   </features>
Apr 13 20:30:43 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:30:43 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:30:43 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:30:43 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:30:43 user nova-compute[71285]:   </clock>
Apr 13 20:30:43 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:30:43 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:30:43 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:30:43 user nova-compute[71285]:   </cpu>
Apr 13 20:30:43 user nova-compute[71285]:   <devices>
Apr 13 20:30:43 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:30:43 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:30:43 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk"/>
Apr 13 20:30:43 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:30:43 user nova-compute[71285]:     </disk>
Apr 13 20:30:43 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:30:43 user nova-compute[71285]:       <mac address="fa:16:3e:8b:86:a2"/>
Apr 13 20:30:43 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:43 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:30:43 user nova-compute[71285]:       <target dev="tape0bcdbf3-7f"/>
Apr 13 20:30:43 user nova-compute[71285]:     </interface>
Apr 13 20:30:43 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:30:43 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/console.log" append="off"/>
Apr 13 20:30:43 user nova-compute[71285]:     </serial>
Apr 13 20:30:43 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:30:43 user nova-compute[71285]:     <video>
Apr 13 20:30:43 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:30:43 user nova-compute[71285]:     </video>
Apr 13 20:30:43 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:30:43 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:30:43 user nova-compute[71285]:     </rng>
Apr 13 20:30:43 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:30:43 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:30:43 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:30:43 user nova-compute[71285]:     </memballoon>
Apr 13 20:30:43 user nova-compute[71285]:   </devices>
Apr 13 20:30:43 user nova-compute[71285]: </domain>
Apr 13 20:30:43 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-33634037',display_name='tempest-AttachVolumeNegativeTest-server-33634037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-33634037',id=25,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCCX8u6zrg58hMYOqDCcBgm5ASAk29l64hwlQHGPn9hPSMp9xxNJqil1FLSEZAMwckiBv6hluknAtYjB8bLkAob+IHrbZEf2TIRzSS4TuOzVhrYWPg4XCtNFAg2iOzRag==',key_name='tempest-keypair-867771061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-kyia0z09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=8acd3c03-8835-4b69-aabd-7a5a34b910d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG os_vif [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0bcdbf3-7f, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0bcdbf3-7f, col_values=(('external_ids', {'iface-id': 'e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:86:a2', 'vm-uuid': '8acd3c03-8835-4b69-aabd-7a5a34b910d5'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:43 user nova-compute[71285]: INFO os_vif [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f')
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:8b:86:a2, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updated VIF entry in instance network info cache for port e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating instance_info_cache with network_info: [{"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ab2743b-eac0-47ba-b284-8700f446f9a4 req-3cb7d1e4-69e8-4241-bd90-9b20ffb498b0 service nova] Releasing lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] No waiting events found dispatching network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:44 user nova-compute[71285]: WARNING nova.compute.manager [req-8264c5f4-0103-48db-b228-f1e7fd97402e req-e150071e-d7d4-4bf2-99c7-3d4bd2185fcb service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received unexpected event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance with vm_state building and task_state spawning.
Apr 13 20:30:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417846.5314047, 8acd3c03-8835-4b69-aabd-7a5a34b910d5 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] VM Resumed (Lifecycle Event)
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Instance spawned successfully.
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417846.5353856, 8acd3c03-8835-4b69-aabd-7a5a34b910d5 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] VM Started (Lifecycle Event)
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:30:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Took 6.39 seconds to build instance.
Apr 13 20:30:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ca033148-6466-4461-affb-62386ce583fc tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.477s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] No waiting events found dispatching network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:46 user nova-compute[71285]: WARNING nova.compute.manager [req-05660cbe-ce8e-49a0-9c33-c7f374a995d9 req-57421ae1-fdc5-47a9-a1e6-89c0f453205b service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received unexpected event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance with vm_state active and task_state None.
Apr 13 20:30:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:47 user nova-compute[71285]: INFO nova.compute.manager [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Detaching volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:30:47 user nova-compute[71285]: INFO nova.virt.block_device [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attempting to driver detach volume 1017ad5b-45cd-4f0b-a368-4af26c71c74c from mountpoint /dev/vdb
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Attempting to detach device vdb from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:30:47 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:30:47 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:30:47 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:30:47 user nova-compute[71285]:   <serial>1017ad5b-45cd-4f0b-a368-4af26c71c74c</serial>
Apr 13 20:30:47 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:30:47 user nova-compute[71285]: </disk>
Apr 13 20:30:47 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:30:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully detached device vdb from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the persistent domain config.
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:30:47 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:30:47 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:30:47 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:30:47 user nova-compute[71285]:   <serial>1017ad5b-45cd-4f0b-a368-4af26c71c74c</serial>
Apr 13 20:30:47 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:30:47 user nova-compute[71285]: </disk>
Apr 13 20:30:47 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417847.879658, b8bcf189-a781-474e-bc4f-8a471a661e93 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:30:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully detached device vdb from instance b8bcf189-a781-474e-bc4f-8a471a661e93 from the live domain config.
Apr 13 20:30:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bSWftHRO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[612da36f-c053-41ab-b855-4f74dd998f47]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:30:47 user nova-compute[71285]: No targets found.
Apr 13 20:30:47 user nova-compute[71285]: iSNS:
Apr 13 20:30:47 user nova-compute[71285]: No targets found.
Apr 13 20:30:47 user nova-compute[71285]: STATIC:
Apr 13 20:30:47 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a
Apr 13 20:30:47 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:47 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:47 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc
Apr 13 20:30:47 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:47 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:47 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c
Apr 13 20:30:47 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:47 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:47 user nova-compute[71285]: FIRMWARE:
Apr 13 20:30:47 user nova-compute[71285]: No targets found.
Apr 13 20:30:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:30:47 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:30:47 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68edcc6b-0471-49cd-9fbb-60249fd697a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb5dcea-20ae-4ab3-bb6a-a674fa44ddf5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:47 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:47 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c (non-flash)
Apr 13 20:30:47 user nova-compute[71285]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:47 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc64156710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03f26d4-2366-4971-a63d-a7a0549d3f70]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[40942905-abea-4c57-b597-28e95a0efbb3]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9f2332-ec91-4de9-bced-5636a2c4a616]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2103d9ff-d374-4a8e-81ea-ab05be2b226d]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63edb6cf-6315-4926-aa89-a4881684a7bd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6834471c-643c-4dcc-9ece-2b86cae26328]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260]
Apr 13 20:30:48 user nova-compute[71285]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c, portal: 172.16.0.220,3260] successful.
Apr 13 20:30:48 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1017ad5b-45cd-4f0b-a368-4af26c71c74c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcbb9d4-53e3-4af3-92a8-9f23c3f7ab53]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (303ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:30:49 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'flavor' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4277b4f8-470b-4974-afba-b72d2c4e3b25 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.760s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.128s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=26.348487854003906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 7d01394e-edb8-4c51-a71a-e07c0ee164db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ee274ffc-0455-4733-8a69-33f1210ed781 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:30:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:30:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:30:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:30:54 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:30:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [{"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-7d01394e-edb8-4c51-a71a-e07c0ee164db" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:55 user nova-compute[71285]: INFO nova.compute.manager [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Terminating instance
Apr 13 20:30:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-unplugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] No waiting events found dispatching network-vif-unplugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-d9fc2a13-d6c0-4ea6-9b55-d3e9a841926b req-dc4e34fa-535c-4d94-bbf8-d6cb6580b39b service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-unplugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Instance destroyed successfully.
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid ee274ffc-0455-4733-8a69-33f1210ed781 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:29:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-301039361',display_name='tempest-TestVolumeBootPattern-server-301039361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-301039361',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-22phj6c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:29:21Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=ee274ffc-0455-4733-8a69-33f1210ed781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "address": "fa:16:3e:d1:47:31", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a7478fd-29", "ovs_interfaceid": "7a7478fd-2933-48b0-acdb-1bab32cefd46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_vif [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a7478fd-29, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:56 user nova-compute[71285]: INFO os_vif [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:47:31,bridge_name='br-int',has_traffic_filtering=True,id=7a7478fd-2933-48b0-acdb-1bab32cefd46,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a7478fd-29')
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewJTsAgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:30:56 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cff47c-5d91-4bab-9a80-ca8730d1d2f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:30:56 user nova-compute[71285]: No targets found.
Apr 13 20:30:56 user nova-compute[71285]: iSNS:
Apr 13 20:30:56 user nova-compute[71285]: No targets found.
Apr 13 20:30:56 user nova-compute[71285]: STATIC:
Apr 13 20:30:56 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a
Apr 13 20:30:56 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:56 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:56 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc
Apr 13 20:30:56 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:30:56 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:30:56 user nova-compute[71285]: FIRMWARE:
Apr 13 20:30:56 user nova-compute[71285]: No targets found.
Apr 13 20:30:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:30:56 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:30:56 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c131b1-f92f-43d2-8ecf-697645548d2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ce268c-10cb-4a75-9e1e-b158ae4a1ccf]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:56 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc (non-flash)
Apr 13 20:30:56 user nova-compute[71285]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:30:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6413ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6829e93e-62d1-4ec9-84d7-ed5a7857cb62]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9184c4f0-4f20-48ba-a00b-47463083a80e]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f37f20a-92f3-4d63-923b-17e47b0de3f7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1098ac70-e1d9-47c9-a204-08dfdc45e58a]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26435303662306361', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_20cf5088', '/dev/disk/by-id/scsi-1SCST_BIO20cf5088-d506b0cab89353d4') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edcca52-f516-4633-827b-9ef4b6998368]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd5e37-bd9d-416b-a13e-2a259663bd18]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[de76540a-1376-4c54-afc3-bd0d75eeedb6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260]
Apr 13 20:30:56 user nova-compute[71285]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc, portal: 172.16.0.220,3260] successful.
Apr 13 20:30:56 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b483629-6280-4749-ad86-af9b6a9a5dcc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacab934-39b0-431e-ae8c-d1371ab80f78]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (289ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:30:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Deleting instance files /opt/stack/data/nova/instances/ee274ffc-0455-4733-8a69-33f1210ed781_del
Apr 13 20:30:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Deletion of /opt/stack/data/nova/instances/ee274ffc-0455-4733-8a69-33f1210ed781_del complete
Apr 13 20:30:56 user nova-compute[71285]: INFO nova.compute.manager [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 13 20:30:56 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:30:56 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:30:57 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:30:57 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Took 0.45 seconds to deallocate network for instance.
Apr 13 20:30:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-deleted-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:57 user nova-compute[71285]: INFO nova.compute.manager [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Neutron deleted interface 7a7478fd-2933-48b0-acdb-1bab32cefd46; detaching it from the instance and deleting it from the info cache
Apr 13 20:30:57 user nova-compute[71285]: DEBUG nova.network.neutron [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:30:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-a3ad2dec-35a1-442a-91b6-c5f5855273d2 req-47d9197b-05d3-4d44-ae22-5b113765caef service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Detach interface failed, port_id=7a7478fd-2933-48b0-acdb-1bab32cefd46, reason: Instance ee274ffc-0455-4733-8a69-33f1210ed781 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:30:58 user nova-compute[71285]: INFO nova.compute.manager [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Took 0.77 seconds to detach 1 volumes for instance.
Apr 13 20:30:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Deleting volume: 2b483629-6280-4749-ad86-af9b6a9a5dcc {{(pid=71285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Acquiring lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] Lock "ee274ffc-0455-4733-8a69-33f1210ed781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] No waiting events found dispatching network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:30:58 user nova-compute[71285]: WARNING nova.compute.manager [req-2d078303-a69d-4dee-94c5-44166dd6fff3 req-aa9d9170-d1c2-449d-8b27-9717d021d523 service nova] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Received unexpected event network-vif-plugged-7a7478fd-2933-48b0-acdb-1bab32cefd46 for instance with vm_state active and task_state deleting.
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:30:58 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance ee274ffc-0455-4733-8a69-33f1210ed781
Apr 13 20:30:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-36fde41d-9157-4aea-961a-fcb0527aaaec tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "ee274ffc-0455-4733-8a69-33f1210ed781" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:11 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417856.5527368, ee274ffc-0455-4733-8a69-33f1210ed781 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:31:11 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] VM Stopped (Lifecycle Event)
Apr 13 20:31:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5af29c40-e488-4f6c-8b5e-7b2abddeddf8 None None] [instance: ee274ffc-0455-4733-8a69-33f1210ed781] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:31:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:31:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:34 user nova-compute[71285]: INFO nova.compute.manager [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Terminating instance
Apr 13 20:31:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:31:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-89e387eb-d3a9-47fc-a79d-59ad569c8058 req-ea606599-085a-40ff-9d0a-38d6fa1ea84a service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-unplugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Instance destroyed successfully.
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.objects.instance [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'resources' on Instance uuid 7d01394e-edb8-4c51-a71a-e07c0ee164db {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-492449566',display_name='tempest-AttachVolumeTestJSON-server-492449566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-492449566',id=12,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL+xPu9aYMVwzV340M+w2yDiVrSy0rMf4yrNU+7IKJIJZs4vvkwsJ7jmjRX27m1GPH+pzZqJ4dzbD+k/n3HnIi7aVSI5PqMz48aW5LkOtEseasta+oz5lQ0u3Y1WvLaRg==',key_name='tempest-keypair-262567265',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-r6twyqn7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=7d01394e-edb8-4c51-a71a-e07c0ee164db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "address": "fa:16:3e:b8:5a:71", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5b9a9b4-bd", "ovs_interfaceid": "b5b9a9b4-bd38-4cfc-b483-9bae4721fb09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG os_vif [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5b9a9b4-bd, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:35 user nova-compute[71285]: INFO os_vif [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:5a:71,bridge_name='br-int',has_traffic_filtering=True,id=b5b9a9b4-bd38-4cfc-b483-9bae4721fb09,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5b9a9b4-bd')
Apr 13 20:31:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Deleting instance files /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db_del
Apr 13 20:31:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Deletion of /opt/stack/data/nova/instances/7d01394e-edb8-4c51-a71a-e07c0ee164db_del complete
Apr 13 20:31:35 user nova-compute[71285]: INFO nova.compute.manager [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 13 20:31:35 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:31:35 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:35 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Took 0.67 seconds to deallocate network for instance.
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:36 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Deleted allocations for instance 7d01394e-edb8-4c51-a71a-e07c0ee164db
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-531d295d-6821-471b-af05-6159f5bb05ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.018s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Acquiring lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] Lock "7d01394e-edb8-4c51-a71a-e07c0ee164db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] No waiting events found dispatching network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:31:36 user nova-compute[71285]: WARNING nova.compute.manager [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received unexpected event network-vif-plugged-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 for instance with vm_state deleted and task_state None.
Apr 13 20:31:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-01658d4c-f230-473b-9ef1-d93443a90cd6 req-f8d7c556-6ee7-4f75-a1e0-6b2387a39dc7 service nova] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Received event network-vif-deleted-b5b9a9b4-bd38-4cfc-b483-9bae4721fb09 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:45 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417895.2174387, 7d01394e-edb8-4c51-a71a-e07c0ee164db => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:31:50 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] VM Stopped (Lifecycle Event)
Apr 13 20:31:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-82e38ea0-5e82-439b-adce-f97b7282df1a None None] [instance: 7d01394e-edb8-4c51-a71a-e07c0ee164db] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:31:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=26.347461700439453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 57c6121a-c1be-467c-888f-1c42b03f95cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:31:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:31:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:31:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:31:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updating instance_info_cache with network_info: [{"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-57c6121a-c1be-467c-888f-1c42b03f95cf" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:31:55 user nova-compute[71285]: INFO nova.compute.claims [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Claim successful on node user
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.compute.manager [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Terminating instance
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.715s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.virt.block_device [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Booting with volume 2b663208-c712-444c-9d05-1b84e247c6ac at /dev/vda
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.policy [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.utils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-50dede5c-dd5e-4d91-a055-ae43dcc114c9 req-6e89853e-dfe1-4ea7-8005-372fa3fe3e49 service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-unplugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adca5f9-e093-443a-9d1d-fa7f4aed565b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab2a05-f977-4fdc-95a6-1fa60f934f8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d7ce6-1c0c-49d7-b262-5416939147bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9416aeab-dbf0-4099-8e1f-20e1ca173970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:31:56 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03e3134-bad5-491d-927b-143d986d5f6a]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_brick.utils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updating existing volume attachment record: d9375105-d873-404b-bc72-70680ac6fc99 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Instance destroyed successfully.
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lazy-loading 'resources' on Instance uuid 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:26:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1206860275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1206860275',id=22,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7bjG5pVyew1iMJGqVQAxyEL2SLVPg9WtjkR2GAHwrOAtXUXLy5O5gyuSVZRjngyh7gzHwecvMgf5lTzLtkHEU+E+Li7QlCYySw1RXDYaRvTOjrN0y1RquDWwlSaxchVw==',key_name='tempest-keypair-103925243',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:30:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='405aed9fca044ab39eabe188942230d2',ramdisk_id='',reservation_id='r-5pp7455i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-160294736',owner_user_name='tempest-AttachVolumeShelveTestJSON-160294736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36e11efc98604eb7a8d5b95563431e45',uuid=4c067bb3-5a8d-4198-9b35-bf8dc2a98962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converting VIF {"id": "a573f361-5e24-4509-aa70-50df8b98cf0d", "address": "fa:16:3e:e3:4d:81", "network": {"id": "c8b2ab21-23b9-4644-b252-4cd4bd700fbc", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1821412608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "405aed9fca044ab39eabe188942230d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa573f361-5e", "ovs_interfaceid": "a573f361-5e24-4509-aa70-50df8b98cf0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG os_vif [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa573f361-5e, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:56 user nova-compute[71285]: INFO os_vif [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:4d:81,bridge_name='br-int',has_traffic_filtering=True,id=a573f361-5e24-4509-aa70-50df8b98cf0d,network=Network(c8b2ab21-23b9-4644-b252-4cd4bd700fbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa573f361-5e')
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Deleting instance files /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962_del
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Deletion of /opt/stack/data/nova/instances/4c067bb3-5a8d-4198-9b35-bf8dc2a98962_del complete
Apr 13 20:31:56 user nova-compute[71285]: INFO nova.compute.manager [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Took 0.73 seconds to destroy the instance on the hypervisor.
Apr 13 20:31:56 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:31:56 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Successfully created port: d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:57 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Took 0.94 seconds to deallocate network for instance.
Apr 13 20:31:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:58 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Deleted allocations for instance 4c067bb3-5a8d-4198-9b35-bf8dc2a98962
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Successfully updated port: d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-changed-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Refreshing instance network info cache due to event network-changed-d4d99364-e2da-4757-ab7c-38f903f15a19. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Acquiring lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:31:58 user nova-compute[71285]: INFO nova.compute.manager [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Terminating instance
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-563f5147-7bf6-4d85-9307-3ae319f398e1 tempest-AttachVolumeShelveTestJSON-160294736 tempest-AttachVolumeShelveTestJSON-160294736-project-member] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.509s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Acquiring lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] Lock "4c067bb3-5a8d-4198-9b35-bf8dc2a98962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] No waiting events found dispatching network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:31:58 user nova-compute[71285]: WARNING nova.compute.manager [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received unexpected event network-vif-plugged-a573f361-5e24-4509-aa70-50df8b98cf0d for instance with vm_state deleted and task_state None.
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-711119ef-95fd-4056-8fe5-e83966a8a48f req-2dfc534d-c6d7-46c4-b469-4cb588aef98d service nova] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Received event network-vif-deleted-a573f361-5e24-4509-aa70-50df8b98cf0d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-unplugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] No waiting events found dispatching network-vif-unplugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-4fa234c0-6554-446d-b409-c9316759b73a req-77f622bc-c922-4d23-8898-210efeed0bd3 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-unplugged-5d781018-f7d5-445e-9d00-55c8ff93194c for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updating instance_info_cache with network_info: [{"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Instance network_info: |[{"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Acquired lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:31:58 user nova-compute[71285]: DEBUG nova.network.neutron [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Refreshing network info cache for port d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:31:59 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Instance destroyed successfully.
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lazy-loading 'resources' on Instance uuid 57c6121a-c1be-467c-888f-1c42b03f95cf {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1107246113',display_name='tempest-ServersNegativeTestJSON-server-1107246113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1107246113',id=14,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:23:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='376fa6e005894aee80e4398704d956a7',ramdisk_id='',reservation_id='r-k2z9yhnr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1377252178',owner_user_name='tempest-ServersNegativeTestJSON-1377252178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:23:23Z,user_data=None,user_id='e39152c6dfed4218aa473532c49844ff',uuid=57c6121a-c1be-467c-888f-1c42b03f95cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converting VIF {"id": "5d781018-f7d5-445e-9d00-55c8ff93194c", "address": "fa:16:3e:5f:ba:30", "network": {"id": "a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-622878654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "376fa6e005894aee80e4398704d956a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d781018-f7", "ovs_interfaceid": "5d781018-f7d5-445e-9d00-55c8ff93194c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG os_vif [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d781018-f7, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:31:59 user nova-compute[71285]: INFO os_vif [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:ba:30,bridge_name='br-int',has_traffic_filtering=True,id=5d781018-f7d5-445e-9d00-55c8ff93194c,network=Network(a6bd6b62-5bac-46c4-8ec6-263a2c2b8eba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d781018-f7')
Apr 13 20:31:59 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Deleting instance files /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf_del
Apr 13 20:31:59 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Deletion of /opt/stack/data/nova/instances/57c6121a-c1be-467c-888f-1c42b03f95cf_del complete
Apr 13 20:31:59 user nova-compute[71285]: INFO nova.compute.manager [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 20:31:59 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updated VIF entry in instance network info cache for port d4d99364-e2da-4757-ab7c-38f903f15a19. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updating instance_info_cache with network_info: [{"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3839d512-d40e-4bb3-a845-f48ad487bd4d req-0f29f828-40b2-4467-a57f-1aa7bbef1d4a service nova] Releasing lock "refresh_cache-3e6800d3-8537-4a89-877a-c049f0670590" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:31:59 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Took 0.43 seconds to deallocate network for instance.
Apr 13 20:31:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:31:59 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:00 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Deleted allocations for instance 57c6121a-c1be-467c-888f-1c42b03f95cf
Apr 13 20:32:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a9c89bc2-a56b-402e-84bf-642de7176ea3 tempest-ServersNegativeTestJSON-1377252178 tempest-ServersNegativeTestJSON-1377252178-project-member] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.754s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG nova.compute.manager [req-6191f877-6d2b-4236-bcc4-42484d21216b req-70e5f930-74a9-4b43-adf2-70937d2fe8f1 service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-deleted-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Acquiring lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] Lock "57c6121a-c1be-467c-888f-1c42b03f95cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:00 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] No waiting events found dispatching network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:00 user nova-compute[71285]: WARNING nova.compute.manager [req-a8dff270-ea8e-497f-89ce-fbba7bebc1f0 req-addaee08-dfe4-4724-bda8-2f0bf1437d6d service nova] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Received unexpected event network-vif-plugged-5d781018-f7d5-445e-9d00-55c8ff93194c for instance with vm_state deleted and task_state None.
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:32:01 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Creating image(s)
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Ensure instance console log exists: /opt/stack/data/nova/instances/3e6800d3-8537-4a89-877a-c049f0670590/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Start _get_guest_xml network_info=[{"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQqBEXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3e6800d3-8537-4a89-877a-c049f0670590', 'attached_at': '', 'detached_at': '', 'volume_id': '2b663208-c712-444c-9d05-1b84e247c6ac', 'serial': '2b663208-c712-444c-9d05-1b84e247c6ac'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'd9375105-d873-404b-bc72-70680ac6fc99', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:32:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQqBEXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:01 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:01 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:01 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6faef82-10b4-44ca-a4f7-52e35c100254]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:32:01 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e5da6-1f67-4ad8-9471-18e6bb3b227b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac] added
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[571be29f-ac90-45bc-9fc7-2f36b5a6964d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c078d1-4a0e-4f0d-b4df-17b1030cd7fb]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbQqBEXz {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbQqBEXz" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0f202-79af-46d2-8671-ba712c2ee984]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbQqBEXz'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ccf1b8-e618-41e9-a8ba-d1ad2b28d72d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c88c55-a064-4684-9ab3-a050e15e6120]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668bc0a-1103-4880-a593-a5d78a117be0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260]
Apr 13 20:32:01 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a1269b-fc46-4789-a407-184f65be6bed]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba6a7bd-ebdc-433e-a4b8-d84328e61e5f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:01 user nova-compute[71285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:01 user nova-compute[71285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8917d1-3c0f-4cf5-9128-00743d2244b7]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:32:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQqBEXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23363643036613632', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363643036613632', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-704536365',display_name='tempest-TestVolumeBootPattern-volume-backed-server-704536365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-704536365',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-3rfee89h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:31:56Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=3e6800d3-8537-4a89-877a-c049f0670590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid 3e6800d3-8537-4a89-877a-c049f0670590 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:32:02 user nova-compute[71285]:   <uuid>3e6800d3-8537-4a89-877a-c049f0670590</uuid>
Apr 13 20:32:02 user nova-compute[71285]:   <name>instance-0000001a</name>
Apr 13 20:32:02 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:32:02 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:32:02 user nova-compute[71285]:   <metadata>
Apr 13 20:32:02 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:32:02 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:32:02 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-704536365</nova:name>
Apr 13 20:32:02 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:32:01</nova:creationTime>
Apr 13 20:32:02 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:32:02 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:32:02 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:32:02 user nova-compute[71285]:       <nova:owner>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:32:02 user nova-compute[71285]:       </nova:owner>
Apr 13 20:32:02 user nova-compute[71285]:       <nova:ports>
Apr 13 20:32:02 user nova-compute[71285]:         <nova:port uuid="d4d99364-e2da-4757-ab7c-38f903f15a19">
Apr 13 20:32:02 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 20:32:02 user nova-compute[71285]:         </nova:port>
Apr 13 20:32:02 user nova-compute[71285]:       </nova:ports>
Apr 13 20:32:02 user nova-compute[71285]:     </nova:instance>
Apr 13 20:32:02 user nova-compute[71285]:   </metadata>
Apr 13 20:32:02 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:32:02 user nova-compute[71285]:     <system>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="serial">3e6800d3-8537-4a89-877a-c049f0670590</entry>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="uuid">3e6800d3-8537-4a89-877a-c049f0670590</entry>
Apr 13 20:32:02 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:32:02 user nova-compute[71285]:     </system>
Apr 13 20:32:02 user nova-compute[71285]:   </sysinfo>
Apr 13 20:32:02 user nova-compute[71285]:   <os>
Apr 13 20:32:02 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:32:02 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:32:02 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:32:02 user nova-compute[71285]:   </os>
Apr 13 20:32:02 user nova-compute[71285]:   <features>
Apr 13 20:32:02 user nova-compute[71285]:     <acpi/>
Apr 13 20:32:02 user nova-compute[71285]:     <apic/>
Apr 13 20:32:02 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:32:02 user nova-compute[71285]:   </features>
Apr 13 20:32:02 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:32:02 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:32:02 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:32:02 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:32:02 user nova-compute[71285]:   </clock>
Apr 13 20:32:02 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:32:02 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:32:02 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:32:02 user nova-compute[71285]:   </cpu>
Apr 13 20:32:02 user nova-compute[71285]:   <devices>
Apr 13 20:32:02 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:32:02 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:02 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:32:02 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:32:02 user nova-compute[71285]:       <serial>2b663208-c712-444c-9d05-1b84e247c6ac</serial>
Apr 13 20:32:02 user nova-compute[71285]:     </disk>
Apr 13 20:32:02 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:32:02 user nova-compute[71285]:       <mac address="fa:16:3e:a9:1a:91"/>
Apr 13 20:32:02 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:02 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:32:02 user nova-compute[71285]:       <target dev="tapd4d99364-e2"/>
Apr 13 20:32:02 user nova-compute[71285]:     </interface>
Apr 13 20:32:02 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:32:02 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/3e6800d3-8537-4a89-877a-c049f0670590/console.log" append="off"/>
Apr 13 20:32:02 user nova-compute[71285]:     </serial>
Apr 13 20:32:02 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:32:02 user nova-compute[71285]:     <video>
Apr 13 20:32:02 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:02 user nova-compute[71285]:     </video>
Apr 13 20:32:02 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:32:02 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:32:02 user nova-compute[71285]:     </rng>
Apr 13 20:32:02 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:32:02 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:32:02 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:32:02 user nova-compute[71285]:     </memballoon>
Apr 13 20:32:02 user nova-compute[71285]:   </devices>
Apr 13 20:32:02 user nova-compute[71285]: </domain>
Apr 13 20:32:02 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-704536365',display_name='tempest-TestVolumeBootPattern-volume-backed-server-704536365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-704536365',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-3rfee89h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:31:56Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=3e6800d3-8537-4a89-877a-c049f0670590,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG os_vif [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d99364-e2, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4d99364-e2, col_values=(('external_ids', {'iface-id': 'd4d99364-e2da-4757-ab7c-38f903f15a19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:1a:91', 'vm-uuid': '3e6800d3-8537-4a89-877a-c049f0670590'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:02 user nova-compute[71285]: INFO os_vif [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2')
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:a9:1a:91, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] No waiting events found dispatching network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:04 user nova-compute[71285]: WARNING nova.compute.manager [req-bd5a0e2e-5c80-42ad-8f41-a5017f9af8ff req-9a05f24f-2175-44a5-bbec-03c9ee7f9f51 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received unexpected event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 for instance with vm_state building and task_state spawning.
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:32:05 user nova-compute[71285]: INFO nova.compute.claims [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Claim successful on node user
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:32:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:32:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.policy [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c89de9f7e5014fa8b0ff7b808bedfb91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f747e06fa64492af3195a88e527bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Creating image(s)
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417926.3431518, 3e6800d3-8537-4a89-877a-c049f0670590 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] VM Resumed (Lifecycle Event)
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Instance spawned successfully.
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] No waiting events found dispatching network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:06 user nova-compute[71285]: WARNING nova.compute.manager [req-c524c9f8-a6de-4725-9301-bcd52dceb715 req-a27cbd02-b85a-4a89-aa7d-6447fb7dfd57 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received unexpected event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 for instance with vm_state building and task_state spawning.
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417926.3436162, 3e6800d3-8537-4a89-877a-c049f0670590 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] VM Started (Lifecycle Event)
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.196s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk 1073741824" returned: 0 in 0.054s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Took 5.14 seconds to spawn the instance on the hypervisor.
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:06 user nova-compute[71285]: INFO nova.compute.manager [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Took 11.03 seconds to build instance.
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-79744d19-9719-4cbe-93c6-38056c1a1260 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.124s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.174s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Cannot resize image /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Ensure instance console log exists: /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Successfully created port: 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Successfully updated port: 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing instance network info cache due to event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance network_info: |[{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start _get_guest_xml network_info=[{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:32:08 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:08 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-675837111',display_name='tempest-ServerRescueNegativeTestJSON-server-675837111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-675837111',id=27,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB786rORhQxc4xur8ylm9URgCf1Ty59hjrLsa8BWuLoAgtAb3i83xpJ5ZXO+s/6wHVdt5Q/i+YiNlTUqN6RbDsKZfJ2v1Fjei+P1wDPDX400QY+aaJpsYbgDSONX/FKbA==',key_name='tempest-keypair-768981879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-e530glrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=fd729f88-fb57-4e9b-9cb8-645dcd4ae441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:32:08 user nova-compute[71285]:   <uuid>fd729f88-fb57-4e9b-9cb8-645dcd4ae441</uuid>
Apr 13 20:32:08 user nova-compute[71285]:   <name>instance-0000001b</name>
Apr 13 20:32:08 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:32:08 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:32:08 user nova-compute[71285]:   <metadata>
Apr 13 20:32:08 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:32:08 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-675837111</nova:name>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:32:08</nova:creationTime>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:32:08 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:32:08 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:owner>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:32:08 user nova-compute[71285]:       </nova:owner>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:32:08 user nova-compute[71285]:       <nova:ports>
Apr 13 20:32:08 user nova-compute[71285]:         <nova:port uuid="09a5e612-1d46-4b74-bfaa-d5eb100ca621">
Apr 13 20:32:08 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 20:32:08 user nova-compute[71285]:         </nova:port>
Apr 13 20:32:08 user nova-compute[71285]:       </nova:ports>
Apr 13 20:32:08 user nova-compute[71285]:     </nova:instance>
Apr 13 20:32:08 user nova-compute[71285]:   </metadata>
Apr 13 20:32:08 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:32:08 user nova-compute[71285]:     <system>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="serial">fd729f88-fb57-4e9b-9cb8-645dcd4ae441</entry>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="uuid">fd729f88-fb57-4e9b-9cb8-645dcd4ae441</entry>
Apr 13 20:32:08 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:32:08 user nova-compute[71285]:     </system>
Apr 13 20:32:08 user nova-compute[71285]:   </sysinfo>
Apr 13 20:32:08 user nova-compute[71285]:   <os>
Apr 13 20:32:08 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:32:08 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:32:08 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:32:08 user nova-compute[71285]:   </os>
Apr 13 20:32:08 user nova-compute[71285]:   <features>
Apr 13 20:32:08 user nova-compute[71285]:     <acpi/>
Apr 13 20:32:08 user nova-compute[71285]:     <apic/>
Apr 13 20:32:08 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:32:08 user nova-compute[71285]:   </features>
Apr 13 20:32:08 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:32:08 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:32:08 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:32:08 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:32:08 user nova-compute[71285]:   </clock>
Apr 13 20:32:08 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:32:08 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:32:08 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:32:08 user nova-compute[71285]:   </cpu>
Apr 13 20:32:08 user nova-compute[71285]:   <devices>
Apr 13 20:32:08 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:32:08 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:32:08 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk"/>
Apr 13 20:32:08 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:32:08 user nova-compute[71285]:     </disk>
Apr 13 20:32:08 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:32:08 user nova-compute[71285]:       <mac address="fa:16:3e:15:19:ae"/>
Apr 13 20:32:08 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:08 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:32:08 user nova-compute[71285]:       <target dev="tap09a5e612-1d"/>
Apr 13 20:32:08 user nova-compute[71285]:     </interface>
Apr 13 20:32:08 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:32:08 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/console.log" append="off"/>
Apr 13 20:32:08 user nova-compute[71285]:     </serial>
Apr 13 20:32:08 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:32:08 user nova-compute[71285]:     <video>
Apr 13 20:32:08 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:08 user nova-compute[71285]:     </video>
Apr 13 20:32:08 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:32:08 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:32:08 user nova-compute[71285]:     </rng>
Apr 13 20:32:08 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:32:08 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:32:08 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:32:08 user nova-compute[71285]:     </memballoon>
Apr 13 20:32:08 user nova-compute[71285]:   </devices>
Apr 13 20:32:08 user nova-compute[71285]: </domain>
Apr 13 20:32:08 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-675837111',display_name='tempest-ServerRescueNegativeTestJSON-server-675837111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-675837111',id=27,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB786rORhQxc4xur8ylm9URgCf1Ty59hjrLsa8BWuLoAgtAb3i83xpJ5ZXO+s/6wHVdt5Q/i+YiNlTUqN6RbDsKZfJ2v1Fjei+P1wDPDX400QY+aaJpsYbgDSONX/FKbA==',key_name='tempest-keypair-768981879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-e530glrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=fd729f88-fb57-4e9b-9cb8-645dcd4ae441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG os_vif [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09a5e612-1d, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09a5e612-1d, col_values=(('external_ids', {'iface-id': '09a5e612-1d46-4b74-bfaa-d5eb100ca621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:19:ae', 'vm-uuid': 'fd729f88-fb57-4e9b-9cb8-645dcd4ae441'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:08 user nova-compute[71285]: INFO os_vif [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d')
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:15:19:ae, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updated VIF entry in instance network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-44f0b8b3-7828-4354-90e3-59e29b535bb6 req-fad00550-a75c-4302-849b-d343ac9f3115 service nova] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:09 user nova-compute[71285]: WARNING nova.compute.manager [req-ab7e86ac-87af-45b2-a211-7c815e464c32 req-2dd3604e-619a-4847-8760-baeed9a0eac3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state building and task_state spawning.
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417931.793555, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Resumed (Lifecycle Event)
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance spawned successfully.
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417916.839259, 4c067bb3-5a8d-4198-9b35-bf8dc2a98962 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] VM Stopped (Lifecycle Event)
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417931.7976859, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Started (Lifecycle Event)
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b70b80f5-34fa-4fff-b2a9-24524f658769 None None] [instance: 4c067bb3-5a8d-4198-9b35-bf8dc2a98962] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:11 user nova-compute[71285]: INFO nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Took 5.85 seconds to spawn the instance on the hypervisor.
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:11 user nova-compute[71285]: WARNING nova.compute.manager [req-bc85d906-610d-4f55-895d-334445a947d3 req-b1f94e4c-fc11-4e8f-8114-72f23b04d8e3 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state building and task_state spawning.
Apr 13 20:32:12 user nova-compute[71285]: INFO nova.compute.manager [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Took 6.47 seconds to build instance.
Apr 13 20:32:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1a5b6f8-ffc9-445a-9079-084f90b28a6e tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417919.1750958, 57c6121a-c1be-467c-888f-1c42b03f95cf => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:14 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] VM Stopped (Lifecycle Event)
Apr 13 20:32:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-2ece3ecd-9ddf-4fc4-8115-ff9fd3a063a7 None None] [instance: 57c6121a-c1be-467c-888f-1c42b03f95cf] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing instance network info cache due to event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updated VIF entry in instance network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8b32711c-e6f1-444d-ac96-e5359b97302a req-fe5c9d45-6bec-4be5-9746-054478cebfc4 service nova] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing instance network info cache due to event network-changed-616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Acquiring lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Acquired lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Refreshing network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:32:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:16 user nova-compute[71285]: INFO nova.compute.manager [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Detaching volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a
Apr 13 20:32:16 user nova-compute[71285]: INFO nova.virt.block_device [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Attempting to driver detach volume 80e647b5-ac5e-491b-acfc-32f350f2cc4a from mountpoint /dev/vdb
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Attempting to detach device vdb from instance 5be87410-64d6-43f1-b8f2-70ace93f90ce from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:32:16 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:16 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:32:16 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:16 user nova-compute[71285]:   <serial>80e647b5-ac5e-491b-acfc-32f350f2cc4a</serial>
Apr 13 20:32:16 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:32:16 user nova-compute[71285]: </disk>
Apr 13 20:32:16 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:32:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully detached device vdb from instance 5be87410-64d6-43f1-b8f2-70ace93f90ce from the persistent domain config.
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5be87410-64d6-43f1-b8f2-70ace93f90ce from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:32:16 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:16 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:32:16 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:16 user nova-compute[71285]:   <serial>80e647b5-ac5e-491b-acfc-32f350f2cc4a</serial>
Apr 13 20:32:16 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 13 20:32:16 user nova-compute[71285]: </disk>
Apr 13 20:32:16 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updated VIF entry in instance network info cache for port 616b4969-2bbc-47cf-ac86-236d2fb36468. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.network.neutron [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [{"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7ca5b86-37cc-4e44-b332-0185cf4924fd req-0adb94d9-8bef-4368-a7ab-e91e9a1dd757 service nova] Releasing lock "refresh_cache-5be87410-64d6-43f1-b8f2-70ace93f90ce" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417936.5729005, 5be87410-64d6-43f1-b8f2-70ace93f90ce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:32:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully detached device vdb from instance 5be87410-64d6-43f1-b8f2-70ace93f90ce from the live domain config.
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RLkQrJnp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:16 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ab5a9e-7c7e-44a8-b08b-5223047b166c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:32:16 user nova-compute[71285]: No targets found.
Apr 13 20:32:16 user nova-compute[71285]: iSNS:
Apr 13 20:32:16 user nova-compute[71285]: No targets found.
Apr 13 20:32:16 user nova-compute[71285]: STATIC:
Apr 13 20:32:16 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:32:16 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:16 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:16 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a
Apr 13 20:32:16 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:16 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:16 user nova-compute[71285]: FIRMWARE:
Apr 13 20:32:16 user nova-compute[71285]: No targets found.
Apr 13 20:32:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:32:16 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:32:16 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2925910b-8e07-4514-a396-46403f287a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84647fc-439d-4b73-b29d-1554fcb9f956]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:16 user nova-compute[71285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a (non-flash)
Apr 13 20:32:16 user nova-compute[71285]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6d891750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c7ad0-2a72-4861-9a76-fbc3423986f6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8038309c-e50b-4e4c-ba2a-91f5c368dc4c]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9487c17-27ff-42c5-9235-8fe6f5dcd223]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4156998a-aa87-46cf-82c1-c3c5b8ed5a4b]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bfffee-72b6-4d13-a843-901907fd22fa]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25def88-b023-478e-a184-d934cb46fee3]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260]
Apr 13 20:32:16 user nova-compute[71285]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80e647b5-ac5e-491b-acfc-32f350f2cc4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca5cd7f-a928-4b68-a0c9-9eeb6899324c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== disconnect_volume: return (282ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:32:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c24dc056-197d-4d37-a1e2-c17c805c0467 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.817s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:32:28 user nova-compute[71285]: INFO nova.compute.claims [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Claim successful on node user
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:32:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.policy [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b5210a73b1574e82838f3f0ccef93a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '587bca93ee3f45b9b5b1ceb91e972e7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:32:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Creating image(s)
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "/opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "/opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "/opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk 1073741824" returned: 0 in 0.049s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Successfully created port: 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Cannot resize image /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'migration_context' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Ensure instance console log exists: /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Successfully updated port: 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquired lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-changed-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Refreshing instance network info cache due to event network-changed-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Acquiring lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating instance_info_cache with network_info: [{"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Releasing lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Instance network_info: |[{"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Acquired lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.neutron [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Refreshing network info cache for port 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Start _get_guest_xml network_info=[{"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:32:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758761895',display_name='tempest-AttachVolumeTestJSON-server-758761895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758761895',id=28,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxyFfcxKO+lPHZHZA8kfKWxEvzIV81dWX33k2emGB4oNguvST61Qj6LSYBEY1hzgxv/SRx/KGzUsi/U1+Fbxx3iIU9HdkWNMNVlsH3GSLEvkEFJlhr8lbeYflCzZq2JAQ==',key_name='tempest-keypair-677859878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-9ny0ok61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=06095354-ac91-443e-8181-dfa44a14ba77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'pci_devices' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:32:30 user nova-compute[71285]:   <uuid>06095354-ac91-443e-8181-dfa44a14ba77</uuid>
Apr 13 20:32:30 user nova-compute[71285]:   <name>instance-0000001c</name>
Apr 13 20:32:30 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:32:30 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:32:30 user nova-compute[71285]:   <metadata>
Apr 13 20:32:30 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:32:30 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeTestJSON-server-758761895</nova:name>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:32:30</nova:creationTime>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:32:30 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:32:30 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:owner>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:user uuid="b5210a73b1574e82838f3f0ccef93a25">tempest-AttachVolumeTestJSON-1545246928-project-member</nova:user>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:project uuid="587bca93ee3f45b9b5b1ceb91e972e7b">tempest-AttachVolumeTestJSON-1545246928</nova:project>
Apr 13 20:32:30 user nova-compute[71285]:       </nova:owner>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:32:30 user nova-compute[71285]:       <nova:ports>
Apr 13 20:32:30 user nova-compute[71285]:         <nova:port uuid="0c0bbbad-8a34-4585-ae25-fbf2e9e42df3">
Apr 13 20:32:30 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 20:32:30 user nova-compute[71285]:         </nova:port>
Apr 13 20:32:30 user nova-compute[71285]:       </nova:ports>
Apr 13 20:32:30 user nova-compute[71285]:     </nova:instance>
Apr 13 20:32:30 user nova-compute[71285]:   </metadata>
Apr 13 20:32:30 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:32:30 user nova-compute[71285]:     <system>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="serial">06095354-ac91-443e-8181-dfa44a14ba77</entry>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="uuid">06095354-ac91-443e-8181-dfa44a14ba77</entry>
Apr 13 20:32:30 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:32:30 user nova-compute[71285]:     </system>
Apr 13 20:32:30 user nova-compute[71285]:   </sysinfo>
Apr 13 20:32:30 user nova-compute[71285]:   <os>
Apr 13 20:32:30 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:32:30 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:32:30 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:32:30 user nova-compute[71285]:   </os>
Apr 13 20:32:30 user nova-compute[71285]:   <features>
Apr 13 20:32:30 user nova-compute[71285]:     <acpi/>
Apr 13 20:32:30 user nova-compute[71285]:     <apic/>
Apr 13 20:32:30 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:32:30 user nova-compute[71285]:   </features>
Apr 13 20:32:30 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:32:30 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:32:30 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:32:30 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:32:30 user nova-compute[71285]:   </clock>
Apr 13 20:32:30 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:32:30 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:32:30 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:32:30 user nova-compute[71285]:   </cpu>
Apr 13 20:32:30 user nova-compute[71285]:   <devices>
Apr 13 20:32:30 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:32:30 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:32:30 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk"/>
Apr 13 20:32:30 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:32:30 user nova-compute[71285]:     </disk>
Apr 13 20:32:30 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:32:30 user nova-compute[71285]:       <mac address="fa:16:3e:06:09:84"/>
Apr 13 20:32:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:30 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:32:30 user nova-compute[71285]:       <target dev="tap0c0bbbad-8a"/>
Apr 13 20:32:30 user nova-compute[71285]:     </interface>
Apr 13 20:32:30 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:32:30 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/console.log" append="off"/>
Apr 13 20:32:30 user nova-compute[71285]:     </serial>
Apr 13 20:32:30 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:32:30 user nova-compute[71285]:     <video>
Apr 13 20:32:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:32:30 user nova-compute[71285]:     </video>
Apr 13 20:32:30 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:32:30 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:32:30 user nova-compute[71285]:     </rng>
Apr 13 20:32:30 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:32:30 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:32:30 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:32:30 user nova-compute[71285]:     </memballoon>
Apr 13 20:32:30 user nova-compute[71285]:   </devices>
Apr 13 20:32:30 user nova-compute[71285]: </domain>
Apr 13 20:32:30 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758761895',display_name='tempest-AttachVolumeTestJSON-server-758761895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758761895',id=28,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxyFfcxKO+lPHZHZA8kfKWxEvzIV81dWX33k2emGB4oNguvST61Qj6LSYBEY1hzgxv/SRx/KGzUsi/U1+Fbxx3iIU9HdkWNMNVlsH3GSLEvkEFJlhr8lbeYflCzZq2JAQ==',key_name='tempest-keypair-677859878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-9ny0ok61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=06095354-ac91-443e-8181-dfa44a14ba77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG os_vif [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c0bbbad-8a, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c0bbbad-8a, col_values=(('external_ids', {'iface-id': '0c0bbbad-8a34-4585-ae25-fbf2e9e42df3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:09:84', 'vm-uuid': '06095354-ac91-443e-8181-dfa44a14ba77'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:30 user nova-compute[71285]: INFO os_vif [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a')
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No VIF found with MAC fa:16:3e:06:09:84, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updated VIF entry in instance network info cache for port 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating instance_info_cache with network_info: [{"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c4b595d2-d9a9-49d1-ba33-5699f14f8a4f req-5736cc56-c6c4-4f79-b8ed-714318581bc7 service nova] Releasing lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-changed-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Refreshing instance network info cache due to event network-changed-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Acquiring lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Acquired lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.network.neutron [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Refreshing network info cache for port e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] No waiting events found dispatching network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:32 user nova-compute[71285]: WARNING nova.compute.manager [req-0d9aa921-e785-4009-8996-c90f36075ae2 req-d9a876cf-b02b-4ae5-969a-83e1b4e056d5 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received unexpected event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance with vm_state building and task_state spawning.
Apr 13 20:32:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.network.neutron [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updated VIF entry in instance network info cache for port e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG nova.network.neutron [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating instance_info_cache with network_info: [{"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6de2e0c6-1d8c-4867-8184-ac92a045e0bd req-63671dc3-d7c7-4f5b-bf65-b2db675f3692 service nova] Releasing lock "refresh_cache-8acd3c03-8835-4b69-aabd-7a5a34b910d5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417954.2663176, 06095354-ac91-443e-8181-dfa44a14ba77 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] VM Resumed (Lifecycle Event)
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Instance spawned successfully.
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] No waiting events found dispatching network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:34 user nova-compute[71285]: WARNING nova.compute.manager [req-1397f6b1-b9b2-4f46-801f-0bead12f478e req-6f7392fa-371f-48be-93b1-939e68ffe1f1 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received unexpected event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance with vm_state building and task_state spawning.
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417954.2682376, 06095354-ac91-443e-8181-dfa44a14ba77 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] VM Started (Lifecycle Event)
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Took 5.81 seconds to spawn the instance on the hypervisor.
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Took 6.48 seconds to build instance.
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-571b27ae-d7d2-4eae-a40a-3634a091a119 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.580s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:34 user nova-compute[71285]: INFO nova.compute.manager [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Attaching volume 19a92049-37e4-4d45-99ea-e2863952fb31 to /dev/vdb
Apr 13 20:32:34 user nova-compute[71285]: DEBUG os_brick.utils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaa6cfe-220e-49f5-854b-bd8fdca62638]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da1a9b-1feb-4068-9736-4ff634c498d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1550ae-ea7c-4ec5-8c3d-a7d0878d4944]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[71390b73-4449-4a89-b8ee-d92cdad367b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:35 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:32:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[914858b2-63e9-4ffd-9c07-9a7862cfd349]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG os_brick.utils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating existing volume attachment record: 420fd6ea-cd87-4dbf-a9b0-07a02a2519ef {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:32:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcukJRZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:39 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:39 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:39 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca032e-4373-49f7-abd2-9ed988596f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:32:39 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21a772a-b68a-4d8a-9740-162eebf8d413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31] added
Apr 13 20:32:39 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aa57f4-0f47-4489-a560-8bdcd14e3a9a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7a8569-1786-455b-b605-f8c7d91ff60a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcukJRZj {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcukJRZj" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cecdd64-a284-4bf2-8cf7-c14a9b3dcd88]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcukJRZj'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a670cf11-79ed-42a6-ad26-e68f052d0a03]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:39 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ea6c0-7e80-443e-a676-c411c2519ccb]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:40 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:40 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b1b51-b667-4eeb-aa97-c7198a96a235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260]
Apr 13 20:32:40 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:40 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af049b65-db88-4263-8fcf-3879bae69dc0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[770ea6a3-4ad9-4b1e-9d54-9075bbb498d2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:40 user nova-compute[71285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)
Apr 13 20:32:40 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:40 user nova-compute[71285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)
Apr 13 20:32:40 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9631963c-1452-4d41-a2e1-e80117de8532]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcukJRZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:40 user nova-compute[71285]: DEBUG nova.objects.instance [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'flavor' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:41 user nova-compute[71285]: INFO nova.compute.manager [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attaching volume 69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb to /dev/vdb
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26664636433353433', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664636433353433', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:32:41 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:41 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:32:41 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:41 user nova-compute[71285]:   <serial>19a92049-37e4-4d45-99ea-e2863952fb31</serial>
Apr 13 20:32:41 user nova-compute[71285]: </disk>
Apr 13 20:32:41 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.utils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c713e9-ecb5-41d5-a822-e9c1fdfa5324]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9873d-9e8d-407b-be57-1abff083c529]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3ffe5-f6ba-4347-b57b-f7bc9dda33d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5f324-e694-447c-aa12-3a4c58e643fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:41 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88849b50-8abc-407c-a140-6131a6fcd766]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG os_brick.utils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating existing volume attachment record: 50176849-8486-4a73-b090-3f7f592f3209 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:8b:86:a2, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:32:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-753a0811-eb41-478d-a12f-c701b3c6ab3b tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.877s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:42 user nova-compute[71285]: INFO nova.compute.manager [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Detaching volume 19a92049-37e4-4d45-99ea-e2863952fb31
Apr 13 20:32:42 user nova-compute[71285]: INFO nova.virt.block_device [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Attempting to driver detach volume 19a92049-37e4-4d45-99ea-e2863952fb31 from mountpoint /dev/vdb
Apr 13 20:32:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Attempting to detach device vdb from instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:32:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:32:42 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:42 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:32:42 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:42 user nova-compute[71285]:   <serial>19a92049-37e4-4d45-99ea-e2863952fb31</serial>
Apr 13 20:32:42 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:32:42 user nova-compute[71285]: </disk>
Apr 13 20:32:42 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:32:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 from the persistent domain config.
Apr 13 20:32:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:32:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:32:42 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:42 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:32:42 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:42 user nova-compute[71285]:   <serial>19a92049-37e4-4d45-99ea-e2863952fb31</serial>
Apr 13 20:32:42 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:32:42 user nova-compute[71285]: </disk>
Apr 13 20:32:42 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681417963.3587627, 8acd3c03-8835-4b69-aabd-7a5a34b910d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:32:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 from the live domain config.
Apr 13 20:32:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcukJRZj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:43 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28339f0-bcbf-48b6-b562-e7062b7cbb34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:32:43 user nova-compute[71285]: No targets found.
Apr 13 20:32:43 user nova-compute[71285]: iSNS:
Apr 13 20:32:43 user nova-compute[71285]: No targets found.
Apr 13 20:32:43 user nova-compute[71285]: STATIC:
Apr 13 20:32:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:32:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:43 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31
Apr 13 20:32:43 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:43 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:43 user nova-compute[71285]: FIRMWARE:
Apr 13 20:32:43 user nova-compute[71285]: No targets found.
Apr 13 20:32:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:32:43 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:32:43 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd501712-201f-41a9-8729-654ebb2b1cf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d4e63-a4c8-4e08-bfc3-d45c4faadb8d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:43 user nova-compute[71285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)
Apr 13 20:32:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:43 user nova-compute[71285]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 (non-flash)
Apr 13 20:32:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc640df370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2455d65-fd82-4adb-9bd9-deffdde28caa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5d1493-917b-4474-a025-7bdb4742a4bb]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ffa1c6-3da7-42b7-a0fc-005e763a3527]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f52ace-1d71-4876-9860-b15873566e41]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488125f-f1fd-41b9-9dd1-c7f1fd37a378]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e09bcf-9242-4e8d-86fa-dcafdfa2cc4b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260]
Apr 13 20:32:43 user nova-compute[71285]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:43 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a92049-37e4-4d45-99ea-e2863952fb31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[763170b3-b1cc-4bae-b09e-d06c15791e60]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== disconnect_volume: return (286ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:32:44 user nova-compute[71285]: DEBUG nova.objects.instance [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-10f6b7fe-74ff-4124-846f-45a134dab260 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.745s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:45 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:45 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:45 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce07b3b-a1f6-4a5d-af34-92556dd51adf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:32:45 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16af64e-9cc4-4372-9e18-72968ea726fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added
Apr 13 20:32:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8096b2-78ee-458d-9ea2-f6810649ad8a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bb23f9-b687-441d-b963-317d63454faf]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16a777a-c67f-4e9f-bf20-29f803acace6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UlbstDHd'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0eae7-c616-4906-8dc6-d7e644c9b121]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ccd8b1-7f57-4a69-b919-9988992d4fdc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b8a46-c201-4284-b4cc-e848e100f2d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:32:46 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[06230bef-1170-404c-9d28-100768517018]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff66ab6-9078-4aa9-89af-1657cbfccb3a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:46 user nova-compute[71285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:32:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:46 user nova-compute[71285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:32:46 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[216a3fb4-b259-46f4-9df4-3df98d6661ad]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:32:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'flavor' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:32:47 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:32:47 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:32:47 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:32:47 user nova-compute[71285]:   <serial>69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb</serial>
Apr 13 20:32:47 user nova-compute[71285]: </disk>
Apr 13 20:32:47 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:a6:33:90, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:32:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-88374a61-b643-49d0-a93e-430868c9ee05 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.523s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Stashing vm_state: active {{(pid=71285) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 20:32:50 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_requests' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:32:51 user nova-compute[71285]: INFO nova.compute.claims [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Claim successful on node user
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:32:51 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating resource usage from migration 0fac526e-ebd2-4549-b35c-0de461829805
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.592s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:51 user nova-compute[71285]: INFO nova.compute.manager [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Migrating
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:51 user nova-compute[71285]: INFO nova.compute.rpcapi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Starting migrate_disk_and_power_off {{(pid=71285) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:52 user nova-compute[71285]: WARNING nova.compute.manager [req-c53a5201-a12d-4b5a-8f20-ed271a8832ab req-d85959fb-377e-4632-8eb9-9a6813aefa1a service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state resize_migrating.
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:32:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance destroyed successfully.
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:32:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:32:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=26.333683013916016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0918fa-03, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:32:53 user nova-compute[71285]: INFO os_vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:53 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fcf5fd-e3cf-4ac4-b070-a92348ebc21d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:32:53 user nova-compute[71285]: No targets found.
Apr 13 20:32:53 user nova-compute[71285]: iSNS:
Apr 13 20:32:53 user nova-compute[71285]: No targets found.
Apr 13 20:32:53 user nova-compute[71285]: STATIC:
Apr 13 20:32:53 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:32:53 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:53 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:53 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:32:53 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:32:53 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:32:53 user nova-compute[71285]: FIRMWARE:
Apr 13 20:32:53 user nova-compute[71285]: No targets found.
Apr 13 20:32:53 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:32:53 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:32:53 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa8b14-880e-45c5-9013-edee61caeebe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75bece8-b1fa-4da5-aa19-72de04161efa]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:53 user nova-compute[71285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:32:53 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:32:53 user nova-compute[71285]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:32:53 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc640dc550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Applying migration context for instance b8bcf189-a781-474e-bc4f-8a471a661e93 as it has an incoming, in-progress migration 0fac526e-ebd2-4549-b35c-0de461829805. Migration status is migrating {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 20:32:53 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating resource usage from migration 0fac526e-ebd2-4549-b35c-0de461829805
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16978af1-3e17-420b-816f-33c5e79bbb83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5be87410-64d6-43f1-b8f2-70ace93f90ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 3e6800d3-8537-4a89-877a-c049f0670590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 06095354-ac91-443e-8181-dfa44a14ba77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Migration 0fac526e-ebd2-4549-b35c-0de461829805 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6d38a4-4c64-491f-a6b6-c3b69ec2e6b4]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e374d90d-f5d7-4e17-ac81-fcca21a6335b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a9b9c-e1bf-4b05-a478-b8d649e0cece]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb09f3e-a89e-4d80-a64e-87b01762f358]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de87209-5562-40e9-af5f-e2398eb5d5ad]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:32:54 user nova-compute[71285]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:32:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7401e4a-f8db-497b-98ca-0ed2406a6eaa]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (318ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_resize/disk /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "cp -r /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_resize/disk /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk" returned: 0 in 0.273s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_resize/disk.info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "cp -r /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_resize/disk.info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk.info" returned: 0 in 0.033s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:32:54 user nova-compute[71285]: WARNING nova.compute.manager [req-0ea8fdfb-9d41-4331-ba27-fb45b1989582 req-78894c57-50a9-477d-a1db-0858fd40d951 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state resize_migrating.
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Port 2a0918fa-0318-4cee-aa86-e65201b06aa8 binding to destination host user is already ACTIVE {{(pid=71285) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:32:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[def97431-e619-42b9-bf05-a58f7e249460]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a171ed6-d343-44f1-8e32-d0fc5e2cc001]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[531d6e2f-c0ce-43ea-a9d1-497c926e1a15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4ac620-1f45-4698-9206-51b47a6848a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:32:57 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:32:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8659b5d0-3099-423d-9511-f5fcf4524790]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:32:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:32:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Starting finish_migration {{(pid=71285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:33:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating image(s)
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Cannot resize image /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Ensure instance console log exists: /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start _get_guest_xml network_info=[{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b8bcf189-a781-474e-bc4f-8a471a661e93', 'attached_at': '2023-04-13T20:33:02.000000', 'detached_at': '', 'volume_id': '69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'serial': '69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': '378d0ae6-fab1-4e30-9a16-c508068a969b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:33:02 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:02 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:33:02 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:33:02 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:33:02 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c60c78-b64f-4be7-bb55-0148d6b9487c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:33:02 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee244029-3604-4e0f-95c2-af1e4af21930]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added
Apr 13 20:33:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf8b93-2e8e-4917-96f0-a10a84a971f8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc59148-e84d-4de0-a85c-040d1d1e3506]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12c87d1-a56c-4ec7-aacb-2fc64d6ebaff]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UlbstDHd'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc46120-b1f1-4348-b379-69dcb6e38010]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3802a8-9133-4546-a58a-9b1caf90acfe]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:33:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:33:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6972c1-90f9-4940-8f68-21dfe5d615d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:33:02 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:33:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.296s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60d3d97-ce8a-4db6-be1b-4ad91c3c5596]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7655096-1149-4819-a03a-bee2ad80ff17]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:33:03 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:33:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:33:03 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:33:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.573s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279dcce-bb9e-4326-801a-f3b83ab339fe]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:33:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.603s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1605ms) {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:33:04 user nova-compute[71285]:   <uuid>b8bcf189-a781-474e-bc4f-8a471a661e93</uuid>
Apr 13 20:33:04 user nova-compute[71285]:   <name>instance-00000012</name>
Apr 13 20:33:04 user nova-compute[71285]:   <memory>196608</memory>
Apr 13 20:33:04 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:33:04 user nova-compute[71285]:   <metadata>
Apr 13 20:33:04 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:33:04 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-181194148</nova:name>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:33:02</nova:creationTime>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:flavor name="m1.micro">
Apr 13 20:33:04 user nova-compute[71285]:         <nova:memory>192</nova:memory>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:33:04 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:owner>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:33:04 user nova-compute[71285]:       </nova:owner>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:33:04 user nova-compute[71285]:       <nova:ports>
Apr 13 20:33:04 user nova-compute[71285]:         <nova:port uuid="2a0918fa-0318-4cee-aa86-e65201b06aa8">
Apr 13 20:33:04 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:33:04 user nova-compute[71285]:         </nova:port>
Apr 13 20:33:04 user nova-compute[71285]:       </nova:ports>
Apr 13 20:33:04 user nova-compute[71285]:     </nova:instance>
Apr 13 20:33:04 user nova-compute[71285]:   </metadata>
Apr 13 20:33:04 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:33:04 user nova-compute[71285]:     <system>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="serial">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="uuid">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:33:04 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:33:04 user nova-compute[71285]:     </system>
Apr 13 20:33:04 user nova-compute[71285]:   </sysinfo>
Apr 13 20:33:04 user nova-compute[71285]:   <os>
Apr 13 20:33:04 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:33:04 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:33:04 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:33:04 user nova-compute[71285]:   </os>
Apr 13 20:33:04 user nova-compute[71285]:   <features>
Apr 13 20:33:04 user nova-compute[71285]:     <acpi/>
Apr 13 20:33:04 user nova-compute[71285]:     <apic/>
Apr 13 20:33:04 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:33:04 user nova-compute[71285]:   </features>
Apr 13 20:33:04 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:33:04 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:33:04 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:33:04 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:33:04 user nova-compute[71285]:   </clock>
Apr 13 20:33:04 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:33:04 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:33:04 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:33:04 user nova-compute[71285]:   </cpu>
Apr 13 20:33:04 user nova-compute[71285]:   <devices>
Apr 13 20:33:04 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:33:04 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:33:04 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk"/>
Apr 13 20:33:04 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:33:04 user nova-compute[71285]:     </disk>
Apr 13 20:33:04 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:33:04 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:33:04 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:33:04 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:33:04 user nova-compute[71285]:       <serial>69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb</serial>
Apr 13 20:33:04 user nova-compute[71285]:     </disk>
Apr 13 20:33:04 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:33:04 user nova-compute[71285]:       <mac address="fa:16:3e:a6:33:90"/>
Apr 13 20:33:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:33:04 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:33:04 user nova-compute[71285]:       <target dev="tap2a0918fa-03"/>
Apr 13 20:33:04 user nova-compute[71285]:     </interface>
Apr 13 20:33:04 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:33:04 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log" append="off"/>
Apr 13 20:33:04 user nova-compute[71285]:     </serial>
Apr 13 20:33:04 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:33:04 user nova-compute[71285]:     <video>
Apr 13 20:33:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:33:04 user nova-compute[71285]:     </video>
Apr 13 20:33:04 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:33:04 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:33:04 user nova-compute[71285]:     </rng>
Apr 13 20:33:04 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:33:04 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:33:04 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:33:04 user nova-compute[71285]:     </memballoon>
Apr 13 20:33:04 user nova-compute[71285]:   </devices>
Apr 13 20:33:04 user nova-compute[71285]: </domain>
Apr 13 20:33:04 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:a6:33:90"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG os_vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0918fa-03, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0918fa-03, col_values=(('external_ids', {'iface-id': '2a0918fa-0318-4cee-aa86-e65201b06aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:33:90', 'vm-uuid': 'b8bcf189-a781-474e-bc4f-8a471a661e93'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:04 user nova-compute[71285]: INFO os_vif [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:33:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:a6:33:90, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:05 user nova-compute[71285]: DEBUG nova.compute.manager [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:05 user nova-compute[71285]: WARNING nova.compute.manager [req-bf3a0a19-9a0c-4a52-8b60-ff9ff7b929dc req-bca66604-b03a-49b4-9d32-96b3b7f36f93 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state resize_finish.
Apr 13 20:33:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:08 user nova-compute[71285]: WARNING nova.compute.manager [req-efea66d1-761c-4265-8181-d432cb6ff75b req-419dbc0d-c403-4e1c-b711-05fadd06da24 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state resize_finish.
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for b8bcf189-a781-474e-bc4f-8a471a661e93 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417988.2304804, b8bcf189-a781-474e-bc4f-8a471a661e93 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Resumed (Lifecycle Event)
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:08 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance running successfully.
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Failed to set time: agent not configured {{(pid=71285) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7d3b17d9-b4da-48ca-a7aa-fe7100b1a968 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] finish_migration finished successfully. {{(pid=71285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:33:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681417988.2320602, b8bcf189-a781-474e-bc4f-8a471a661e93 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Started (Lifecycle Event)
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:33:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 20:33:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:10 user nova-compute[71285]: INFO nova.compute.manager [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Terminating instance
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-45cb2411-a63e-4faf-a15a-ad8ff697c9e9 req-7a50a95d-fffa-4896-933f-81b422f0db54 service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-unplugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Instance destroyed successfully.
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.objects.instance [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'resources' on Instance uuid 5be87410-64d6-43f1-b8f2-70ace93f90ce {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:28:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2066526535',display_name='tempest-TestMinimumBasicScenario-server-2066526535',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2066526535',id=23,image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjmSqvUl8KqxiWYpdbV8fcEEJPM9DquBNTt3TC9TUyCrrXzATpO/iMAndzY/Y7lHxaegFQjzFNIJq9Yrb36neOFYFS6PE2/nBc36qUiuAjBI2rGirfj3b0THTtE8AYLHQ==',key_name='tempest-TestMinimumBasicScenario-1162257408',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-w9760xtl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='54a85f0f-585c-4c38-b211-c4a8d01d6811',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:31Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=5be87410-64d6-43f1-b8f2-70ace93f90ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "616b4969-2bbc-47cf-ac86-236d2fb36468", "address": "fa:16:3e:45:30:60", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap616b4969-2b", "ovs_interfaceid": "616b4969-2bbc-47cf-ac86-236d2fb36468", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG os_vif [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap616b4969-2b, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:33:10 user nova-compute[71285]: INFO os_vif [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:30:60,bridge_name='br-int',has_traffic_filtering=True,id=616b4969-2bbc-47cf-ac86-236d2fb36468,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap616b4969-2b')
Apr 13 20:33:10 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Deleting instance files /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce_del
Apr 13 20:33:10 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Deletion of /opt/stack/data/nova/instances/5be87410-64d6-43f1-b8f2-70ace93f90ce_del complete
Apr 13 20:33:11 user nova-compute[71285]: INFO nova.compute.manager [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 13 20:33:11 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:11 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Took 0.56 seconds to deallocate network for instance.
Apr 13 20:33:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-5679a811-34a8-4923-b14e-88bd3d678547 req-d9b5985f-c018-4c23-a7df-681eb38d914d service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-deleted-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Deleted allocations for instance 5be87410-64d6-43f1-b8f2-70ace93f90ce
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-828e891c-4288-419f-80b7-1c93d115416d tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.145s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:12 user nova-compute[71285]: WARNING nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state deleted and task_state None.
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:12 user nova-compute[71285]: WARNING nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state deleted and task_state None.
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:12 user nova-compute[71285]: WARNING nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state deleted and task_state None.
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Acquiring lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] Lock "5be87410-64d6-43f1-b8f2-70ace93f90ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] No waiting events found dispatching network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:12 user nova-compute[71285]: WARNING nova.compute.manager [req-3af24511-ff87-4587-9f0a-3c1e8a835ff2 req-f8213520-7c81-4634-8eb5-fdbcbcbc415c service nova] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Received unexpected event network-vif-plugged-616b4969-2bbc-47cf-ac86-236d2fb36468 for instance with vm_state deleted and task_state None.
Apr 13 20:33:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:33:20 user nova-compute[71285]: INFO nova.compute.claims [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Claim successful on node user
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:33:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.policy [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:33:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Creating image(s)
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "/opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "/opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk 1073741824" returned: 0 in 0.055s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Successfully created port: b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Cannot resize image /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'migration_context' on Instance uuid a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Ensure instance console log exists: /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Successfully updated port: b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquired lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-changed-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Refreshing instance network info cache due to event network-changed-b0bb456d-5327-4938-8949-7c965ee9221d. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Acquiring lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Updating instance_info_cache with network_info: [{"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Releasing lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Instance network_info: |[{"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Acquired lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.neutron [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Refreshing network info cache for port b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Start _get_guest_xml network_info=[{"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:33:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517346965',display_name='tempest-VolumesActionsTest-instance-517346965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-517346965',id=29,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-cqvkuid2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:33:21Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=a2e756a6-be8f-4c1b-a9b0-182d97b8bf33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'pci_devices' on Instance uuid a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:33:22 user nova-compute[71285]:   <uuid>a2e756a6-be8f-4c1b-a9b0-182d97b8bf33</uuid>
Apr 13 20:33:22 user nova-compute[71285]:   <name>instance-0000001d</name>
Apr 13 20:33:22 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:33:22 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:33:22 user nova-compute[71285]:   <metadata>
Apr 13 20:33:22 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:33:22 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:name>tempest-VolumesActionsTest-instance-517346965</nova:name>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:33:22</nova:creationTime>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:33:22 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:33:22 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:owner>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:user uuid="3993eb2be0d94cdbb16fd233999fc5c2">tempest-VolumesActionsTest-1802743389-project-member</nova:user>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:project uuid="d550373054224fcbbb7300f512ad0345">tempest-VolumesActionsTest-1802743389</nova:project>
Apr 13 20:33:22 user nova-compute[71285]:       </nova:owner>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:33:22 user nova-compute[71285]:       <nova:ports>
Apr 13 20:33:22 user nova-compute[71285]:         <nova:port uuid="b0bb456d-5327-4938-8949-7c965ee9221d">
Apr 13 20:33:22 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:33:22 user nova-compute[71285]:         </nova:port>
Apr 13 20:33:22 user nova-compute[71285]:       </nova:ports>
Apr 13 20:33:22 user nova-compute[71285]:     </nova:instance>
Apr 13 20:33:22 user nova-compute[71285]:   </metadata>
Apr 13 20:33:22 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:33:22 user nova-compute[71285]:     <system>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="serial">a2e756a6-be8f-4c1b-a9b0-182d97b8bf33</entry>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="uuid">a2e756a6-be8f-4c1b-a9b0-182d97b8bf33</entry>
Apr 13 20:33:22 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:33:22 user nova-compute[71285]:     </system>
Apr 13 20:33:22 user nova-compute[71285]:   </sysinfo>
Apr 13 20:33:22 user nova-compute[71285]:   <os>
Apr 13 20:33:22 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:33:22 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:33:22 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:33:22 user nova-compute[71285]:   </os>
Apr 13 20:33:22 user nova-compute[71285]:   <features>
Apr 13 20:33:22 user nova-compute[71285]:     <acpi/>
Apr 13 20:33:22 user nova-compute[71285]:     <apic/>
Apr 13 20:33:22 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:33:22 user nova-compute[71285]:   </features>
Apr 13 20:33:22 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:33:22 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:33:22 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:33:22 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:33:22 user nova-compute[71285]:   </clock>
Apr 13 20:33:22 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:33:22 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:33:22 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:33:22 user nova-compute[71285]:   </cpu>
Apr 13 20:33:22 user nova-compute[71285]:   <devices>
Apr 13 20:33:22 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:33:22 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:33:22 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk"/>
Apr 13 20:33:22 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:33:22 user nova-compute[71285]:     </disk>
Apr 13 20:33:22 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:33:22 user nova-compute[71285]:       <mac address="fa:16:3e:74:37:b8"/>
Apr 13 20:33:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:33:22 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:33:22 user nova-compute[71285]:       <target dev="tapb0bb456d-53"/>
Apr 13 20:33:22 user nova-compute[71285]:     </interface>
Apr 13 20:33:22 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:33:22 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/console.log" append="off"/>
Apr 13 20:33:22 user nova-compute[71285]:     </serial>
Apr 13 20:33:22 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:33:22 user nova-compute[71285]:     <video>
Apr 13 20:33:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:33:22 user nova-compute[71285]:     </video>
Apr 13 20:33:22 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:33:22 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:33:22 user nova-compute[71285]:     </rng>
Apr 13 20:33:22 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:33:22 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:33:22 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:33:22 user nova-compute[71285]:     </memballoon>
Apr 13 20:33:22 user nova-compute[71285]:   </devices>
Apr 13 20:33:22 user nova-compute[71285]: </domain>
Apr 13 20:33:22 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517346965',display_name='tempest-VolumesActionsTest-instance-517346965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-517346965',id=29,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-cqvkuid2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:33:21Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=a2e756a6-be8f-4c1b-a9b0-182d97b8bf33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG os_vif [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0bb456d-53, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0bb456d-53, col_values=(('external_ids', {'iface-id': 'b0bb456d-5327-4938-8949-7c965ee9221d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:37:b8', 'vm-uuid': 'a2e756a6-be8f-4c1b-a9b0-182d97b8bf33'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:22 user nova-compute[71285]: INFO os_vif [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53')
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:33:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] No VIF found with MAC fa:16:3e:74:37:b8, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:33:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Updated VIF entry in instance network info cache for port b0bb456d-5327-4938-8949-7c965ee9221d. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:33:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Updating instance_info_cache with network_info: [{"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-954a9060-e6fc-4b3f-9c78-36f179f41b80 req-2d6d8660-bdca-4072-9ce4-403fbd371385 service nova] Releasing lock "refresh_cache-a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] No waiting events found dispatching network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:24 user nova-compute[71285]: WARNING nova.compute.manager [req-5d6504c4-1f13-4171-a53e-efa4d56a78e4 req-3618602f-d31b-499c-94e8-972b51d75b6a service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received unexpected event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d for instance with vm_state building and task_state spawning.
Apr 13 20:33:25 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681417990.8518765, 5be87410-64d6-43f1-b8f2-70ace93f90ce => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:25 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] VM Stopped (Lifecycle Event)
Apr 13 20:33:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-69755805-cdc3-4638-996a-2883c3ea102b None None] [instance: 5be87410-64d6-43f1-b8f2-70ace93f90ce] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418006.33424, a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] VM Resumed (Lifecycle Event)
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Instance spawned successfully.
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418006.3354769, a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] VM Started (Lifecycle Event)
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Took 5.51 seconds to spawn the instance on the hypervisor.
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] No waiting events found dispatching network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:26 user nova-compute[71285]: WARNING nova.compute.manager [req-9b8bed83-29d0-4ee2-aac5-7b09fade57db req-4f23f27f-f01c-451c-b804-b3f64fcc0a52 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received unexpected event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d for instance with vm_state active and task_state None.
Apr 13 20:33:26 user nova-compute[71285]: INFO nova.compute.manager [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Took 6.24 seconds to build instance.
Apr 13 20:33:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1dbe9071-531a-4efb-a6d6-07bdc0f2fc55 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.330s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:33 user nova-compute[71285]: INFO nova.compute.manager [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Terminating instance
Apr 13 20:33:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-unplugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] No waiting events found dispatching network-vif-unplugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-b36d4b2e-bf34-451b-a201-881e7607ef18 req-4b757256-38a9-4989-a913-cb600ace3f80 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-unplugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:33:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Instance destroyed successfully.
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'resources' on Instance uuid 8acd3c03-8835-4b69-aabd-7a5a34b910d5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-33634037',display_name='tempest-AttachVolumeNegativeTest-server-33634037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-33634037',id=25,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCCX8u6zrg58hMYOqDCcBgm5ASAk29l64hwlQHGPn9hPSMp9xxNJqil1FLSEZAMwckiBv6hluknAtYjB8bLkAob+IHrbZEf2TIRzSS4TuOzVhrYWPg4XCtNFAg2iOzRag==',key_name='tempest-keypair-867771061',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-kyia0z09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=8acd3c03-8835-4b69-aabd-7a5a34b910d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "address": "fa:16:3e:8b:86:a2", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0bcdbf3-7f", "ovs_interfaceid": "e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG os_vif [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0bcdbf3-7f, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:33:34 user nova-compute[71285]: INFO os_vif [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:86:a2,bridge_name='br-int',has_traffic_filtering=True,id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0bcdbf3-7f')
Apr 13 20:33:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Deleting instance files /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5_del
Apr 13 20:33:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Deletion of /opt/stack/data/nova/instances/8acd3c03-8835-4b69-aabd-7a5a34b910d5_del complete
Apr 13 20:33:34 user nova-compute[71285]: INFO nova.compute.manager [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 13 20:33:34 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:33:34 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:35 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Took 0.82 seconds to deallocate network for instance.
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-deleted-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:35 user nova-compute[71285]: INFO nova.compute.manager [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Neutron deleted interface e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b; detaching it from the instance and deleting it from the info cache
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.network.neutron [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-950d63f0-2fdb-4a8d-848c-f3c53453688b req-18d8cc52-d97f-40ec-b730-2368416aa2d6 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Detach interface failed, port_id=e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b, reason: Instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:35 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Deleted allocations for instance 8acd3c03-8835-4b69-aabd-7a5a34b910d5
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7e2ea603-bb81-4638-96e1-104f92e7d278 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Acquiring lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] Lock "8acd3c03-8835-4b69-aabd-7a5a34b910d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] No waiting events found dispatching network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:33:35 user nova-compute[71285]: WARNING nova.compute.manager [req-ccb42be6-f2b3-40d3-b178-788a1fe0e010 req-f520da94-88e2-4296-83c0-59eea14ce617 service nova] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Received unexpected event network-vif-plugged-e0bcdbf3-7f5e-4eda-836b-bbe0af1f239b for instance with vm_state deleted and task_state None.
Apr 13 20:33:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:47 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418014.2000449, 8acd3c03-8835-4b69-aabd-7a5a34b910d5 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:33:49 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] VM Stopped (Lifecycle Event)
Apr 13 20:33:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-37f81fcd-6681-465c-8054-c08d383c9820 None None] [instance: 8acd3c03-8835-4b69-aabd-7a5a34b910d5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:33:49 user nova-compute[71285]: INFO nova.compute.claims [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Claim successful on node user
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:33:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:33:50 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:33:50 user nova-compute[71285]: INFO nova.virt.block_device [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Booting with volume snapshot f15bc8ef-ea4c-47d6-b6f3-8b6068028b6f at /dev/vda
Apr 13 20:33:50 user nova-compute[71285]: DEBUG nova.policy [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Successfully created port: c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Successfully updated port: c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.compute.manager [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-changed-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.compute.manager [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Refreshing instance network info cache due to event network-changed-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Acquiring lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updating instance_info_cache with network_info: [{"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Instance network_info: |[{"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Acquired lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.network.neutron [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Refreshing network info cache for port c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updated VIF entry in instance network info cache for port c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updating instance_info_cache with network_info: [{"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4584ba7b-ec89-445d-b43c-698e51099ca3 req-e8af7530-c295-4a9f-b0f1-20ef84fe1f55 service nova] Releasing lock "refresh_cache-5940c278-df77-472e-a32f-e431c5f4b1d1" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:33:55 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:55 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=26.31975555419922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Applying migration context for instance b8bcf189-a781-474e-bc4f-8a471a661e93 as it has an incoming, in-progress migration 0fac526e-ebd2-4549-b35c-0de461829805. Migration status is finished {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 20:33:55 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating resource usage from migration 0fac526e-ebd2-4549-b35c-0de461829805
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 3e6800d3-8537-4a89-877a-c049f0670590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 06095354-ac91-443e-8181-dfa44a14ba77 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Migration 0fac526e-ebd2-4549-b35c-0de461829805 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1728MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:33:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.utils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12b3358-5f20-4e0f-99fb-2d1d5e45bc24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba5f5b-3ca5-4244-a499-36b30c72f77e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b961aec5-ccd2-40f2-9a70-09dba433f733]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd7f62-d559-426b-9617-ec3642a2eaad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:33:56 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd20db8-b3c4-4b01-8f96-9c37233d837b]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG os_brick.utils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updating existing volume attachment record: 4e7219e8-56f1-481d-96d8-9f013d21c48c {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing instance network info cache due to event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.network.neutron [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:33:56 user nova-compute[71285]: INFO nova.compute.manager [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Attaching volume ea7203e7-62fc-4103-9662-be40fbd06e1e to /dev/vdb
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.network.neutron [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updated VIF entry in instance network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG nova.network.neutron [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:33:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa502493-255d-4198-80d8-a56e1feb0b2a req-bbe62871-70b6-49ba-9ef1-379a63a909ab service nova] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c69161-265b-4f25-8457-341d0a01421a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[634af81f-1e82-421a-a142-5a4b5b48a73e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8611e-4752-44c5-bbe3-83da9b9887be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c680935-8809-4cd9-a5aa-371dc71f9d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:33:57 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb35034-e5c1-42f7-aca2-adc9ebf3a89a]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating existing volume attachment record: 90006948-cf75-4504-8247-456525bbd594 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:33:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:33:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:33:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:34:01 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Creating image(s)
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Ensure instance console log exists: /opt/stack/data/nova/instances/5940c278-df77-472e-a32f-e431c5f4b1d1/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Start _get_guest_xml network_info=[{"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T20:33:47Z,direct_url=<?>,disk_format='qcow2',id=e2252929-c60d-4172-92bf-b4700b193055,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-678969581',owner='65dc7126add94e0c97afbe225c8447a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T20:33:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBkfAWSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5940c278-df77-472e-a32f-e431c5f4b1d1', 'attached_at': '', 'detached_at': '', 'volume_id': '520625c0-f544-49ca-a9ff-ba010dc0a8d7', 'serial': '520625c0-f544-49ca-a9ff-ba010dc0a8d7'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '4e7219e8-56f1-481d-96d8-9f013d21c48c', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:34:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-13T20:33:47Z,direct_url=<?>,disk_format='qcow2',id=e2252929-c60d-4172-92bf-b4700b193055,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-678969581',owner='65dc7126add94e0c97afbe225c8447a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-13T20:33:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBkfAWSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:01 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:01 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:01 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5711c-e868-436c-bd3f-7aea944c0959]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:34:01 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee2d5a-c357-4b99-99e1-84544da5db5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7] added
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bc532e-8235-42c4-bd79-a8cfe46bf7ba]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62222a74-209a-4c13-9069-adcbcb83b488]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBkfAWSE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBkfAWSE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cf0c17-3f68-4672-a31f-6f0bbd7bad12]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBkfAWSE'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b723399-23c5-465d-82d1-13ed6340794c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8582ff-faae-4c11-8512-fb45414c1bd0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a4d1d-ed5d-4f8c-b1b0-5ca3b689a13b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260]
Apr 13 20:34:01 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[274abc6f-4d56-4e2d-acf1-033a3d426a8e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be81e85-09f3-41f8-b35c-485fe1bf6c8e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:01 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:01 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd3209-2a08-49b9-9171-4c04273364e1]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBkfAWSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZlPBEFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:01 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:01 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23533363638626131', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533363638626131', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.760s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:02 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:02 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[772285ee-6600-41f9-8e42-9e20cbce9309]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:34:02 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[142e3352-efff-4b70-a441-7ab686047a8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e] added
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4745a25-9c31-4df8-bda8-d2a6550b605d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1920913930',id=30,image_ref='e2252929-c60d-4172-92bf-b4700b193055',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-cm51v2h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2040418736',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:33:50Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=5940c278-df77-472e-a32f-e431c5f4b1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid 5940c278-df77-472e-a32f-e431c5f4b1d1 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:34:02 user nova-compute[71285]:   <uuid>5940c278-df77-472e-a32f-e431c5f4b1d1</uuid>
Apr 13 20:34:02 user nova-compute[71285]:   <name>instance-0000001e</name>
Apr 13 20:34:02 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:34:02 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:34:02 user nova-compute[71285]:   <metadata>
Apr 13 20:34:02 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:34:02 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1920913930</nova:name>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:34:01</nova:creationTime>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:34:02 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:34:02 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:owner>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:34:02 user nova-compute[71285]:       </nova:owner>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:root type="image" uuid="e2252929-c60d-4172-92bf-b4700b193055"/>
Apr 13 20:34:02 user nova-compute[71285]:       <nova:ports>
Apr 13 20:34:02 user nova-compute[71285]:         <nova:port uuid="c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf">
Apr 13 20:34:02 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:34:02 user nova-compute[71285]:         </nova:port>
Apr 13 20:34:02 user nova-compute[71285]:       </nova:ports>
Apr 13 20:34:02 user nova-compute[71285]:     </nova:instance>
Apr 13 20:34:02 user nova-compute[71285]:   </metadata>
Apr 13 20:34:02 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:34:02 user nova-compute[71285]:     <system>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="serial">5940c278-df77-472e-a32f-e431c5f4b1d1</entry>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="uuid">5940c278-df77-472e-a32f-e431c5f4b1d1</entry>
Apr 13 20:34:02 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:34:02 user nova-compute[71285]:     </system>
Apr 13 20:34:02 user nova-compute[71285]:   </sysinfo>
Apr 13 20:34:02 user nova-compute[71285]:   <os>
Apr 13 20:34:02 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:34:02 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:34:02 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:34:02 user nova-compute[71285]:   </os>
Apr 13 20:34:02 user nova-compute[71285]:   <features>
Apr 13 20:34:02 user nova-compute[71285]:     <acpi/>
Apr 13 20:34:02 user nova-compute[71285]:     <apic/>
Apr 13 20:34:02 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:34:02 user nova-compute[71285]:   </features>
Apr 13 20:34:02 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:34:02 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:34:02 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:34:02 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:34:02 user nova-compute[71285]:   </clock>
Apr 13 20:34:02 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:34:02 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:34:02 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:34:02 user nova-compute[71285]:   </cpu>
Apr 13 20:34:02 user nova-compute[71285]:   <devices>
Apr 13 20:34:02 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:34:02 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:02 user nova-compute[71285]:       <source dev="/dev/sdd"/>
Apr 13 20:34:02 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:34:02 user nova-compute[71285]:       <serial>520625c0-f544-49ca-a9ff-ba010dc0a8d7</serial>
Apr 13 20:34:02 user nova-compute[71285]:     </disk>
Apr 13 20:34:02 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:34:02 user nova-compute[71285]:       <mac address="fa:16:3e:82:d8:34"/>
Apr 13 20:34:02 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:02 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:34:02 user nova-compute[71285]:       <target dev="tapc0da94b7-24"/>
Apr 13 20:34:02 user nova-compute[71285]:     </interface>
Apr 13 20:34:02 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:34:02 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/5940c278-df77-472e-a32f-e431c5f4b1d1/console.log" append="off"/>
Apr 13 20:34:02 user nova-compute[71285]:     </serial>
Apr 13 20:34:02 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:34:02 user nova-compute[71285]:     <video>
Apr 13 20:34:02 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:02 user nova-compute[71285]:     </video>
Apr 13 20:34:02 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:34:02 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:34:02 user nova-compute[71285]:     </rng>
Apr 13 20:34:02 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:34:02 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:34:02 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:34:02 user nova-compute[71285]:     </memballoon>
Apr 13 20:34:02 user nova-compute[71285]:   </devices>
Apr 13 20:34:02 user nova-compute[71285]: </domain>
Apr 13 20:34:02 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1920913930',id=30,image_ref='e2252929-c60d-4172-92bf-b4700b193055',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-cm51v2h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2040418736',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:33:50Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=5940c278-df77-472e-a32f-e431c5f4b1d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_vif [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[688b25e1-3174-4efc-9a00-41ca9055665a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZlPBEFY {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0da94b7-24, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc0da94b7-24, col_values=(('external_ids', {'iface-id': 'c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:d8:34', 'vm-uuid': '5940c278-df77-472e-a32f-e431c5f4b1d1'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:02 user nova-compute[71285]: INFO os_vif [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24')
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wZlPBEFY" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e6b9d-b581-4acc-ab92-41c9eb443765]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wZlPBEFY'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1952c63b-6a51-4e4b-bbd8-d102ab35af04]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:82:d8:34, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6af1e4-eb7e-4dd1-b478-35103120bffd]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de5336a-6c26-41b6-a8ea-84292e2b71b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260]
Apr 13 20:34:02 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df206f01-25fa-474f-8152-6a9f4be1d953]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d95753-2c05-46fe-9e26-4d46cac856cc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6461c-65a1-437f-8a9e-306bb9992fcc]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZlPBEFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] <== connect_volume: return (2081ms) {'type': 'block', 'scsi_wwn': '26536313232313939', 'path': '/dev/sde'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536313232313939', 'path': '/dev/sde'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:34:03 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:03 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:34:03 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:34:03 user nova-compute[71285]:   <serial>ea7203e7-62fc-4103-9662-be40fbd06e1e</serial>
Apr 13 20:34:03 user nova-compute[71285]: </disk>
Apr 13 20:34:03 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] No waiting events found dispatching network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:03 user nova-compute[71285]: WARNING nova.compute.manager [req-7787030f-30c8-4645-a625-09606fb0b423 req-32408abc-03eb-419c-be84-82afd14ed045 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received unexpected event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance with vm_state building and task_state spawning.
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:34:04 user nova-compute[71285]: INFO nova.compute.claims [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Claim successful on node user
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:15:19:ae, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:34:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.policy [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '519afe2b763347ea889f7de8773d7de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f1e999778042e2a606a2ae4072bc83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-476f3b6a-d97a-4a41-8811-4979ab2c9c41 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.888s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:34:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Creating image(s)
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "/opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "/opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "/opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "2a43200de496bbb7b935a839c0c5d58065bb1065" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "2a43200de496bbb7b935a839c0c5d58065bb1065" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.part --force-share --output=json" returned: 0 in 0.128s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG nova.virt.images [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] b68e778d-6c7f-4c39-a545-ef4067ed0d6d was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.part /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Successfully created port: 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.part /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.converted" returned: 0 in 0.487s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "2a43200de496bbb7b935a839c0c5d58065bb1065" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.186s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Rescuing
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] No waiting events found dispatching network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:06 user nova-compute[71285]: WARNING nova.compute.manager [req-10850ec9-a47c-4f8f-9a90-f552235d876b req-5eeed3a2-4309-4805-a1ae-ccabca335d74 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received unexpected event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance with vm_state building and task_state spawning.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "2a43200de496bbb7b935a839c0c5d58065bb1065" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "2a43200de496bbb7b935a839c0c5d58065bb1065" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065,backing_fmt=raw /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Successfully updated port: 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065,backing_fmt=raw /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk 1073741824" returned: 0 in 0.052s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "2a43200de496bbb7b935a839c0c5d58065bb1065" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing instance network info cache due to event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 --force-share --output=json" returned: 0 in 0.152s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking if we can resize image /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Cannot resize image /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'migration_context' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Ensure instance console log exists: /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1f658129-4fb8-42c4-9a7f-2a84dd689c7c req-d0a337c8-c3d1-4a80-94d6-6acf7e78dc4e service nova] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418046.8251727, 5940c278-df77-472e-a32f-e431c5f4b1d1 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] VM Resumed (Lifecycle Event)
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Instance spawned successfully.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418046.8266318, 5940c278-df77-472e-a32f-e431c5f4b1d1 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] VM Started (Lifecycle Event)
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Took 5.88 seconds to spawn the instance on the hypervisor.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:06 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance network_info: |[{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Start _get_guest_xml network_info=[{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:34:01Z,direct_url=<?>,disk_format='qcow2',id=b68e778d-6c7f-4c39-a545-ef4067ed0d6d,min_disk=0,min_ram=0,name='tempest-scenario-img--1217191542',owner='41f1e999778042e2a606a2ae4072bc83',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:34:03Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': 'b68e778d-6c7f-4c39-a545-ef4067ed0d6d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:34:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:34:01Z,direct_url=<?>,disk_format='qcow2',id=b68e778d-6c7f-4c39-a545-ef4067ed0d6d,min_disk=0,min_ram=0,name='tempest-scenario-img--1217191542',owner='41f1e999778042e2a606a2ae4072bc83',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:34:03Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:34:06 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886625623',display_name='tempest-TestMinimumBasicScenario-server-886625623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886625623',id=31,image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2S5vFB89cjhQNHK5tZERx5gotmSUz6nfYAxb1HGI7pIUEexdW1x3UmogJ+OT5avBe+NR2lh0fefQ4RhxvlylngtZR/3ODNtw6vOAC/JGaj6FVzVw6aEo4e8xfRqWS5uA==',key_name='tempest-TestMinimumBasicScenario-1669926210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-ne0tvu22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:34:05Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=858248d1-eefa-462f-a075-078257c736e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'pci_devices' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:07 user nova-compute[71285]: INFO nova.compute.manager [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Took 17.09 seconds to build instance.
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:34:07 user nova-compute[71285]:   <uuid>858248d1-eefa-462f-a075-078257c736e9</uuid>
Apr 13 20:34:07 user nova-compute[71285]:   <name>instance-0000001f</name>
Apr 13 20:34:07 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:34:07 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:34:07 user nova-compute[71285]:   <metadata>
Apr 13 20:34:07 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:34:07 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:name>tempest-TestMinimumBasicScenario-server-886625623</nova:name>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:34:06</nova:creationTime>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:34:07 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:34:07 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:owner>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:user uuid="519afe2b763347ea889f7de8773d7de0">tempest-TestMinimumBasicScenario-1286218256-project-member</nova:user>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:project uuid="41f1e999778042e2a606a2ae4072bc83">tempest-TestMinimumBasicScenario-1286218256</nova:project>
Apr 13 20:34:07 user nova-compute[71285]:       </nova:owner>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:root type="image" uuid="b68e778d-6c7f-4c39-a545-ef4067ed0d6d"/>
Apr 13 20:34:07 user nova-compute[71285]:       <nova:ports>
Apr 13 20:34:07 user nova-compute[71285]:         <nova:port uuid="8e8101de-d339-437b-b94c-e40a63e6e6aa">
Apr 13 20:34:07 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:34:07 user nova-compute[71285]:         </nova:port>
Apr 13 20:34:07 user nova-compute[71285]:       </nova:ports>
Apr 13 20:34:07 user nova-compute[71285]:     </nova:instance>
Apr 13 20:34:07 user nova-compute[71285]:   </metadata>
Apr 13 20:34:07 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:34:07 user nova-compute[71285]:     <system>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="serial">858248d1-eefa-462f-a075-078257c736e9</entry>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="uuid">858248d1-eefa-462f-a075-078257c736e9</entry>
Apr 13 20:34:07 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:34:07 user nova-compute[71285]:     </system>
Apr 13 20:34:07 user nova-compute[71285]:   </sysinfo>
Apr 13 20:34:07 user nova-compute[71285]:   <os>
Apr 13 20:34:07 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:34:07 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:34:07 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:34:07 user nova-compute[71285]:   </os>
Apr 13 20:34:07 user nova-compute[71285]:   <features>
Apr 13 20:34:07 user nova-compute[71285]:     <acpi/>
Apr 13 20:34:07 user nova-compute[71285]:     <apic/>
Apr 13 20:34:07 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:34:07 user nova-compute[71285]:   </features>
Apr 13 20:34:07 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:34:07 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:34:07 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:34:07 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:34:07 user nova-compute[71285]:   </clock>
Apr 13 20:34:07 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:34:07 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:34:07 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:34:07 user nova-compute[71285]:   </cpu>
Apr 13 20:34:07 user nova-compute[71285]:   <devices>
Apr 13 20:34:07 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:34:07 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:34:07 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk"/>
Apr 13 20:34:07 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:34:07 user nova-compute[71285]:     </disk>
Apr 13 20:34:07 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:34:07 user nova-compute[71285]:       <mac address="fa:16:3e:0b:28:2f"/>
Apr 13 20:34:07 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:07 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:34:07 user nova-compute[71285]:       <target dev="tap8e8101de-d3"/>
Apr 13 20:34:07 user nova-compute[71285]:     </interface>
Apr 13 20:34:07 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:34:07 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/console.log" append="off"/>
Apr 13 20:34:07 user nova-compute[71285]:     </serial>
Apr 13 20:34:07 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:34:07 user nova-compute[71285]:     <video>
Apr 13 20:34:07 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:07 user nova-compute[71285]:     </video>
Apr 13 20:34:07 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:34:07 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:34:07 user nova-compute[71285]:     </rng>
Apr 13 20:34:07 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:34:07 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:34:07 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:34:07 user nova-compute[71285]:     </memballoon>
Apr 13 20:34:07 user nova-compute[71285]:   </devices>
Apr 13 20:34:07 user nova-compute[71285]: </domain>
Apr 13 20:34:07 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886625623',display_name='tempest-TestMinimumBasicScenario-server-886625623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886625623',id=31,image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2S5vFB89cjhQNHK5tZERx5gotmSUz6nfYAxb1HGI7pIUEexdW1x3UmogJ+OT5avBe+NR2lh0fefQ4RhxvlylngtZR/3ODNtw6vOAC/JGaj6FVzVw6aEo4e8xfRqWS5uA==',key_name='tempest-TestMinimumBasicScenario-1669926210',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-ne0tvu22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:34:05Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=858248d1-eefa-462f-a075-078257c736e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG os_vif [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e8101de-d3, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e8101de-d3, col_values=(('external_ids', {'iface-id': '8e8101de-d339-437b-b94c-e40a63e6e6aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:28:2f', 'vm-uuid': '858248d1-eefa-462f-a075-078257c736e9'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb74eb2c-7a16-48e5-a3cb-a59f8bf0aa3d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.183s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: INFO os_vif [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3')
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No VIF found with MAC fa:16:3e:0b:28:2f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance destroyed successfully.
Apr 13 20:34:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Attempting rescue
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:34:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Creating image(s)
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue" returned: 0 in 0.049s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'migration_context' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start _get_guest_xml network_info=[{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:15:19:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'numa_topology' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:08 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:08 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-675837111',display_name='tempest-ServerRescueNegativeTestJSON-server-675837111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-675837111',id=27,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB786rORhQxc4xur8ylm9URgCf1Ty59hjrLsa8BWuLoAgtAb3i83xpJ5ZXO+s/6wHVdt5Q/i+YiNlTUqN6RbDsKZfJ2v1Fjei+P1wDPDX400QY+aaJpsYbgDSONX/FKbA==',key_name='tempest-keypair-768981879',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:32:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-e530glrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=fd729f88-fb57-4e9b-9cb8-645dcd4ae441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:15:19:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "vif_mac": "fa:16:3e:15:19:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.objects.instance [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'pci_devices' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:34:08 user nova-compute[71285]:   <uuid>fd729f88-fb57-4e9b-9cb8-645dcd4ae441</uuid>
Apr 13 20:34:08 user nova-compute[71285]:   <name>instance-0000001b</name>
Apr 13 20:34:08 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:34:08 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:34:08 user nova-compute[71285]:   <metadata>
Apr 13 20:34:08 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:34:08 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-675837111</nova:name>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:34:08</nova:creationTime>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:34:08 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:34:08 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:owner>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:user uuid="c89de9f7e5014fa8b0ff7b808bedfb91">tempest-ServerRescueNegativeTestJSON-1471169552-project-member</nova:user>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:project uuid="89f747e06fa64492af3195a88e527bb3">tempest-ServerRescueNegativeTestJSON-1471169552</nova:project>
Apr 13 20:34:08 user nova-compute[71285]:       </nova:owner>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:34:08 user nova-compute[71285]:       <nova:ports>
Apr 13 20:34:08 user nova-compute[71285]:         <nova:port uuid="09a5e612-1d46-4b74-bfaa-d5eb100ca621">
Apr 13 20:34:08 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 13 20:34:08 user nova-compute[71285]:         </nova:port>
Apr 13 20:34:08 user nova-compute[71285]:       </nova:ports>
Apr 13 20:34:08 user nova-compute[71285]:     </nova:instance>
Apr 13 20:34:08 user nova-compute[71285]:   </metadata>
Apr 13 20:34:08 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:34:08 user nova-compute[71285]:     <system>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="serial">fd729f88-fb57-4e9b-9cb8-645dcd4ae441</entry>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="uuid">fd729f88-fb57-4e9b-9cb8-645dcd4ae441</entry>
Apr 13 20:34:08 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:34:08 user nova-compute[71285]:     </system>
Apr 13 20:34:08 user nova-compute[71285]:   </sysinfo>
Apr 13 20:34:08 user nova-compute[71285]:   <os>
Apr 13 20:34:08 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:34:08 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:34:08 user nova-compute[71285]:   </os>
Apr 13 20:34:08 user nova-compute[71285]:   <features>
Apr 13 20:34:08 user nova-compute[71285]:     <acpi/>
Apr 13 20:34:08 user nova-compute[71285]:     <apic/>
Apr 13 20:34:08 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:34:08 user nova-compute[71285]:   </features>
Apr 13 20:34:08 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:34:08 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:34:08 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:34:08 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:34:08 user nova-compute[71285]:   </clock>
Apr 13 20:34:08 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:34:08 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:34:08 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:34:08 user nova-compute[71285]:   </cpu>
Apr 13 20:34:08 user nova-compute[71285]:   <devices>
Apr 13 20:34:08 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:34:08 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:34:08 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue"/>
Apr 13 20:34:08 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:34:08 user nova-compute[71285]:     </disk>
Apr 13 20:34:08 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:34:08 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:34:08 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk"/>
Apr 13 20:34:08 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:34:08 user nova-compute[71285]:     </disk>
Apr 13 20:34:08 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:34:08 user nova-compute[71285]:       <mac address="fa:16:3e:15:19:ae"/>
Apr 13 20:34:08 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:08 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:34:08 user nova-compute[71285]:       <target dev="tap09a5e612-1d"/>
Apr 13 20:34:08 user nova-compute[71285]:     </interface>
Apr 13 20:34:08 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:34:08 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/console.log" append="off"/>
Apr 13 20:34:08 user nova-compute[71285]:     </serial>
Apr 13 20:34:08 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:34:08 user nova-compute[71285]:     <video>
Apr 13 20:34:08 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:08 user nova-compute[71285]:     </video>
Apr 13 20:34:08 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:34:08 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:34:08 user nova-compute[71285]:     </rng>
Apr 13 20:34:08 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:34:08 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:34:08 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:34:08 user nova-compute[71285]:     </memballoon>
Apr 13 20:34:08 user nova-compute[71285]:   </devices>
Apr 13 20:34:08 user nova-compute[71285]: </domain>
Apr 13 20:34:08 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:08 user nova-compute[71285]: WARNING nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state active and task_state rescuing.
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:08 user nova-compute[71285]: WARNING nova.compute.manager [req-3c0639fa-8c40-4fa3-83c7-867f172704cb req-a7f11427-61ea-43fb-8541-73358c42b809 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state active and task_state rescuing.
Apr 13 20:34:08 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance destroyed successfully.
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] No VIF found with MAC fa:16:3e:15:19:ae, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:10 user nova-compute[71285]: WARNING nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state building and task_state spawning.
Apr 13 20:34:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:10 user nova-compute[71285]: WARNING nova.compute.manager [req-927878ee-10d4-49d8-b200-1c3efbedbc13 req-8d7da260-2ea3-409d-9625-5b6d85c4b10c service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state building and task_state spawning.
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:12 user nova-compute[71285]: WARNING nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state active and task_state rescuing.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:12 user nova-compute[71285]: WARNING nova.compute.manager [req-832ff9fe-137e-49c7-8ed4-c4b3b948c4e4 req-e6691ac0-3e54-46a2-a950-e2d8ec11a486 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state active and task_state rescuing.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418052.7672691, 858248d1-eefa-462f-a075-078257c736e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] VM Resumed (Lifecycle Event)
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance spawned successfully.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418052.7689013, 858248d1-eefa-462f-a075-078257c736e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] VM Started (Lifecycle Event)
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Took 8.15 seconds to spawn the instance on the hypervisor.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for fd729f88-fb57-4e9b-9cb8-645dcd4ae441 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418052.9016285, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Resumed (Lifecycle Event)
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-dbbeb300-860e-49cd-bd36-8bcc5c8daab9 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418052.9048302, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Started (Lifecycle Event)
Apr 13 20:34:12 user nova-compute[71285]: INFO nova.compute.manager [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Took 8.94 seconds to build instance.
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a91cba9c-87f6-48bf-8bff-492c8edb70ae tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.054s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-changed-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Refreshing instance network info cache due to event network-changed-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:34:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Acquiring lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Acquired lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Refreshing network info cache for port 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:34:20 user nova-compute[71285]: DEBUG nova.network.neutron [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updated VIF entry in instance network info cache for port 0c0bbbad-8a34-4585-ae25-fbf2e9e42df3. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:34:20 user nova-compute[71285]: DEBUG nova.network.neutron [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating instance_info_cache with network_info: [{"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4b0a3459-8c38-4ade-949a-b49ac046b7c8 req-2d39c268-0fc0-44b9-bf28-665cde5a75d3 service nova] Releasing lock "refresh_cache-06095354-ac91-443e-8181-dfa44a14ba77" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:22 user nova-compute[71285]: INFO nova.compute.manager [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attaching volume aa357970-388f-4b14-b1ca-b792d3a3562a to /dev/vdb
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.utils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db397ab2-0669-4a1f-8840-e5f3b4b7207a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aa54ca-0116-4e61-9dff-419d7b8193cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4de9125-61d8-4fb2-9e0c-0c93816f9e22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b6b8c0-b8c2-4797-a86a-e8f8dc3c3e9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:22 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:34:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa8223-5c2f-4316-bb74-2e4cedae93ac]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG os_brick.utils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:22 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating existing volume attachment record: 634ab7d3-5418-497c-a25f-884b13273b2d {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACtoElOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:27 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:27 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:27 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d8421c-b623-49e3-aa42-6b045bd00a4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:34:27 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[84550b63-b28f-4527-ab8a-e233eb3cf7d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a] added
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225bf57-ee5a-4e2a-95d2-448f2e034e33]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[407e8232-1c2c-4a4d-953c-f2b9e36babcf]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACtoElOe {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACtoElOe" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cba9bd-863e-42a1-bfcf-d2542fe5943e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ACtoElOe'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[033a732d-6200-4e2f-9f01-f6d039242349]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fcc5e0-9362-4d0c-8c5a-786191bd487b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d102ce3-6d23-4ebf-82d5-493fadfcb1c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260]
Apr 13 20:34:27 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a570479a-d894-48cf-bc5e-be57c19a85b9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bb30e2-9c3c-4d7a-a896-f781f9e406d8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:27 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b6930-37fb-44cc-9986-aa4700009245]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACtoElOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:27 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:34:27 user nova-compute[71285]: INFO nova.compute.claims [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Claim successful on node user
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:34:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23433393561663164', 'path': '/dev/sdf'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433393561663164', 'path': '/dev/sdf'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.objects.instance [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.policy [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49383d6f0e7141548370d8bc3b96dfd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '053f656470d94d2a9140f393bad01000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:34:28 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:28 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:34:28 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:34:28 user nova-compute[71285]:   <serial>aa357970-388f-4b14-b1ca-b792d3a3562a</serial>
Apr 13 20:34:28 user nova-compute[71285]: </disk>
Apr 13 20:34:28 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:34:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Creating image(s)
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "/opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk 1073741824" returned: 0 in 0.054s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No VIF found with MAC fa:16:3e:06:09:84, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:34:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-9ac0f173-8460-4ac3-8e10-4157fdeacc6d tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.709s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Cannot resize image /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'migration_context' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Ensure instance console log exists: /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:29 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Successfully created port: 343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Successfully updated port: 343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquired lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-changed-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Refreshing instance network info cache due to event network-changed-343a5e66-81f2-407f-a646-cc52fdd762c9. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Acquiring lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.neutron [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updating instance_info_cache with network_info: [{"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Releasing lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Instance network_info: |[{"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Acquired lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.neutron [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Refreshing network info cache for port 343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Start _get_guest_xml network_info=[{"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:34:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-75809090',display_name='tempest-AttachVolumeNegativeTest-server-75809090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-75809090',id=32,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkeyqTPZ9zMzp+K2DjCVHK8Fa3GGyXnf4flHRT96cr2jBUu9eu68fMFegiIQxTphtLwZPA9dzZOUnzKCoaFrpSY4Hb/zRUN5ub6MdFNW63YZDvgRb0mWJ8/YIj66OtXQ==',key_name='tempest-keypair-1660813888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-w315csk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=0bdf333a-456b-413b-92d6-87e45474905f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:34:30 user nova-compute[71285]:   <uuid>0bdf333a-456b-413b-92d6-87e45474905f</uuid>
Apr 13 20:34:30 user nova-compute[71285]:   <name>instance-00000020</name>
Apr 13 20:34:30 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:34:30 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:34:30 user nova-compute[71285]:   <metadata>
Apr 13 20:34:30 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:34:30 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:name>tempest-AttachVolumeNegativeTest-server-75809090</nova:name>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:34:30</nova:creationTime>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:34:30 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:34:30 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:owner>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:user uuid="49383d6f0e7141548370d8bc3b96dfd9">tempest-AttachVolumeNegativeTest-1371087403-project-member</nova:user>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:project uuid="053f656470d94d2a9140f393bad01000">tempest-AttachVolumeNegativeTest-1371087403</nova:project>
Apr 13 20:34:30 user nova-compute[71285]:       </nova:owner>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:34:30 user nova-compute[71285]:       <nova:ports>
Apr 13 20:34:30 user nova-compute[71285]:         <nova:port uuid="343a5e66-81f2-407f-a646-cc52fdd762c9">
Apr 13 20:34:30 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 20:34:30 user nova-compute[71285]:         </nova:port>
Apr 13 20:34:30 user nova-compute[71285]:       </nova:ports>
Apr 13 20:34:30 user nova-compute[71285]:     </nova:instance>
Apr 13 20:34:30 user nova-compute[71285]:   </metadata>
Apr 13 20:34:30 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:34:30 user nova-compute[71285]:     <system>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="serial">0bdf333a-456b-413b-92d6-87e45474905f</entry>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="uuid">0bdf333a-456b-413b-92d6-87e45474905f</entry>
Apr 13 20:34:30 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:34:30 user nova-compute[71285]:     </system>
Apr 13 20:34:30 user nova-compute[71285]:   </sysinfo>
Apr 13 20:34:30 user nova-compute[71285]:   <os>
Apr 13 20:34:30 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:34:30 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:34:30 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:34:30 user nova-compute[71285]:   </os>
Apr 13 20:34:30 user nova-compute[71285]:   <features>
Apr 13 20:34:30 user nova-compute[71285]:     <acpi/>
Apr 13 20:34:30 user nova-compute[71285]:     <apic/>
Apr 13 20:34:30 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:34:30 user nova-compute[71285]:   </features>
Apr 13 20:34:30 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:34:30 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:34:30 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:34:30 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:34:30 user nova-compute[71285]:   </clock>
Apr 13 20:34:30 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:34:30 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:34:30 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:34:30 user nova-compute[71285]:   </cpu>
Apr 13 20:34:30 user nova-compute[71285]:   <devices>
Apr 13 20:34:30 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:34:30 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:34:30 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk"/>
Apr 13 20:34:30 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:34:30 user nova-compute[71285]:     </disk>
Apr 13 20:34:30 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:34:30 user nova-compute[71285]:       <mac address="fa:16:3e:67:46:02"/>
Apr 13 20:34:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:30 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:34:30 user nova-compute[71285]:       <target dev="tap343a5e66-81"/>
Apr 13 20:34:30 user nova-compute[71285]:     </interface>
Apr 13 20:34:30 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:34:30 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/console.log" append="off"/>
Apr 13 20:34:30 user nova-compute[71285]:     </serial>
Apr 13 20:34:30 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:34:30 user nova-compute[71285]:     <video>
Apr 13 20:34:30 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:30 user nova-compute[71285]:     </video>
Apr 13 20:34:30 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:34:30 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:34:30 user nova-compute[71285]:     </rng>
Apr 13 20:34:30 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:34:30 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:34:30 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:34:30 user nova-compute[71285]:     </memballoon>
Apr 13 20:34:30 user nova-compute[71285]:   </devices>
Apr 13 20:34:30 user nova-compute[71285]: </domain>
Apr 13 20:34:30 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-75809090',display_name='tempest-AttachVolumeNegativeTest-server-75809090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-75809090',id=32,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkeyqTPZ9zMzp+K2DjCVHK8Fa3GGyXnf4flHRT96cr2jBUu9eu68fMFegiIQxTphtLwZPA9dzZOUnzKCoaFrpSY4Hb/zRUN5ub6MdFNW63YZDvgRb0mWJ8/YIj66OtXQ==',key_name='tempest-keypair-1660813888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-w315csk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=0bdf333a-456b-413b-92d6-87e45474905f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG os_vif [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap343a5e66-81, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap343a5e66-81, col_values=(('external_ids', {'iface-id': '343a5e66-81f2-407f-a646-cc52fdd762c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:46:02', 'vm-uuid': '0bdf333a-456b-413b-92d6-87e45474905f'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:30 user nova-compute[71285]: INFO os_vif [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81')
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:67:46:02, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updated VIF entry in instance network info cache for port 343a5e66-81f2-407f-a646-cc52fdd762c9. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:34:31 user nova-compute[71285]: DEBUG nova.network.neutron [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updating instance_info_cache with network_info: [{"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7db85e44-ee62-456e-985e-f3962973fbad req-17764f38-28b4-45f6-9bee-f532797e8898 service nova] Releasing lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] No waiting events found dispatching network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:32 user nova-compute[71285]: WARNING nova.compute.manager [req-556ff582-7348-408b-90c7-8a8531cb35a8 req-9e4ceefe-12f4-47ff-8476-0761b9b80bad service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received unexpected event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 for instance with vm_state building and task_state spawning.
Apr 13 20:34:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:32 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:33 user nova-compute[71285]: INFO nova.compute.manager [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attaching volume aaf2141e-9057-4904-acfd-5dad001b1254 to /dev/vdc
Apr 13 20:34:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.utils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1e1165-8d7b-4159-a845-7018962be57b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c190ab-3cd1-459b-b7a0-3d5c62513ea2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4ab363-4e97-482b-a2c2-d81c343c50a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd605d25-fa19-4598-b0af-c23308273361]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:33 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:34:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d16662-87f8-4c04-8b01-92093619e218]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG os_brick.utils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:33 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating existing volume attachment record: f1c4914e-ce4d-436a-bbae-fa4340fc82b6 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418074.726725, 0bdf333a-456b-413b-92d6-87e45474905f => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] VM Resumed (Lifecycle Event)
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Instance spawned successfully.
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418074.7350023, 0bdf333a-456b-413b-92d6-87e45474905f => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] VM Started (Lifecycle Event)
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] No waiting events found dispatching network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:34 user nova-compute[71285]: WARNING nova.compute.manager [req-b1c394a5-5e33-4f38-9739-e097bfccf8a6 req-bdd46cae-4e1c-4b66-b4ad-b3de752090bf service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received unexpected event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 for instance with vm_state building and task_state spawning.
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Took 6.39 seconds to spawn the instance on the hypervisor.
Apr 13 20:34:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:34 user nova-compute[71285]: INFO nova.compute.manager [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Took 7.18 seconds to build instance.
Apr 13 20:34:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-48a10782-7fd9-4de8-a4ca-d5f1959e783f tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.305s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQWEtsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:37 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:37 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:37 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd5e0ec-fe7b-43d9-b6d5-2019a87a2dad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:34:37 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5b31d5-e6f5-4ed8-9c04-1b34cc241856]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254] added
Apr 13 20:34:37 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2489601-1049-472d-8350-eb53fa485b19]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a92ad-25a9-443e-8f10-bf5ccf6fe104]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQWEtsHN {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FQWEtsHN" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791eded-31a5-4164-a0b4-9455c40ec562]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FQWEtsHN'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:37 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5f9cd4-0034-4072-8bf3-d736e8260aed]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ac8918-6889-455a-a51d-f3aea190e813]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95126f67-8aad-4508-9e57-7f30ff2f19f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260]
Apr 13 20:34:38 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55625e1a-e50f-4dc5-84f4-a3ff8cae642f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deae32d-082f-4662-bae6-620dec296685]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:38 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:38 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a6dc1f-cde0-4eba-92ca-be776d1186c5]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:38 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQWEtsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23831393530323034', 'path': '/dev/sdg'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831393530323034', 'path': '/dev/sdg'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:34:39 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:39 user nova-compute[71285]:   <source dev="/dev/sdg"/>
Apr 13 20:34:39 user nova-compute[71285]:   <target dev="vdc" bus="virtio"/>
Apr 13 20:34:39 user nova-compute[71285]:   <serial>aaf2141e-9057-4904-acfd-5dad001b1254</serial>
Apr 13 20:34:39 user nova-compute[71285]: </disk>
Apr 13 20:34:39 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] No VIF found with MAC fa:16:3e:06:09:84, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:34:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8ed4a63-edf2-4ec9-8eaa-7fb9a68c7c38 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.615s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Port 2a0918fa-0318-4cee-aa86-e65201b06aa8 binding to destination host user is already ACTIVE {{(pid=71285) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 20:34:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:34:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Creating tmpfile /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/tmptti8m7gl to verify with other compute node that the instance is on the same shared storage. {{(pid=71285) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:41 user nova-compute[71285]: INFO nova.compute.manager [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Detaching volume aa357970-388f-4b14-b1ca-b792d3a3562a
Apr 13 20:34:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: INFO nova.virt.block_device [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attempting to driver detach volume aa357970-388f-4b14-b1ca-b792d3a3562a from mountpoint /dev/vdb
Apr 13 20:34:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Attempting to detach device vdb from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:34:41 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:41 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:34:41 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:34:41 user nova-compute[71285]:   <serial>aa357970-388f-4b14-b1ca-b792d3a3562a</serial>
Apr 13 20:34:41 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:34:41 user nova-compute[71285]: </disk>
Apr 13 20:34:41 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdb from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the persistent domain config.
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:34:41 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:41 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:34:41 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:34:41 user nova-compute[71285]:   <serial>aa357970-388f-4b14-b1ca-b792d3a3562a</serial>
Apr 13 20:34:41 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:34:41 user nova-compute[71285]: </disk>
Apr 13 20:34:41 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:41 user nova-compute[71285]: WARNING nova.compute.manager [req-e80b4fbd-911f-4c5c-a674-f98d3c84b54e req-441f739a-b62b-4d0a-8283-607336305432 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state resized and task_state resize_reverting.
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418081.6385622, 06095354-ac91-443e-8181-dfa44a14ba77 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:34:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdb from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the live domain config.
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACtoElOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:41 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f127a257-dfa1-42ff-a2c5-d1a70a2e3204]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:34:41 user nova-compute[71285]: No targets found.
Apr 13 20:34:41 user nova-compute[71285]: iSNS:
Apr 13 20:34:41 user nova-compute[71285]: No targets found.
Apr 13 20:34:41 user nova-compute[71285]: STATIC:
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7
Apr 13 20:34:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:41 user nova-compute[71285]: FIRMWARE:
Apr 13 20:34:41 user nova-compute[71285]: No targets found.
Apr 13 20:34:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:34:41 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:34:41 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bab447c-4e4a-4300-b8c4-d1cd2e000638]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd3afdc-eff3-4c1f-9e8b-d4b214f33c9c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a (non-flash)
Apr 13 20:34:41 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a'): ({'sdf'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Removing single pathed devices sdf {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebab31e-8d94-482f-b590-e8158635d929]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f7f15c-3572-4861-a280-37e4b2c80400]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flushing IO for device /dev/sdf {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e1b2c-eae4-444c-8962-faab629f5d2a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a03cfbc-8fa4-41ca-bd59-3f502579d283]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[acae27d5-3b70-49aa-a7c1-f21a2ea1e4c6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance destroyed successfully.
Apr 13 20:34:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fabe3a-2ad4-40eb-b2ea-fea91efc80e2]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260]
Apr 13 20:34:42 user nova-compute[71285]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:42 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:33:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0918fa-03, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa357970-388f-4b14-b1ca-b792d3a3562a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aed881-2102-4349-9fca-c2507f803dc0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== disconnect_volume: return (379ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:42 user nova-compute[71285]: INFO os_vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:42 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15dbf79-77f8-4b4c-926b-2f38fa7b971f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:34:42 user nova-compute[71285]: No targets found.
Apr 13 20:34:42 user nova-compute[71285]: iSNS:
Apr 13 20:34:42 user nova-compute[71285]: No targets found.
Apr 13 20:34:42 user nova-compute[71285]: STATIC:
Apr 13 20:34:42 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:34:42 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:42 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:42 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:34:42 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:42 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:42 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254
Apr 13 20:34:42 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:42 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:42 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:34:42 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:42 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:42 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7
Apr 13 20:34:42 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:42 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:42 user nova-compute[71285]: FIRMWARE:
Apr 13 20:34:42 user nova-compute[71285]: No targets found.
Apr 13 20:34:42 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:34:42 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:34:42 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72399d52-030f-4df7-80fd-d5c46c9e3a21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096be81-1301-4c09-9084-1f504a62663b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:42 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:42 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:42 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc658ac160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88254355-00ee-466f-91ac-4bf74a9f0505]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[44451a16-43fc-4c8e-b218-434a28edb813]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d55eb5c-f9f8-4758-b410-3495f216ed44]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24724b3-be74-424c-9271-e4c6d04e989a]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c9c01-f84d-4f01-b3b9-639cbaabdc46]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97842efa-ab50-47a8-adf3-f70d16dbab3d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:34:42 user nova-compute[71285]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:42 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d791e89-cd41-483e-9e00-c629cb3b0746]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (325ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c5d43fc-a7c6-4aa7-925b-1e5c949c20ac tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'migration_context' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:43 user nova-compute[71285]: WARNING nova.compute.manager [req-698af113-52e3-4ac7-adf0-60f2ff49f3fa req-446bad2e-0233-4a15-a10a-37ece301dae2 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state resized and task_state resize_reverting.
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:43 user nova-compute[71285]: INFO nova.compute.manager [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Detaching volume aaf2141e-9057-4904-acfd-5dad001b1254
Apr 13 20:34:43 user nova-compute[71285]: INFO nova.virt.block_device [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Attempting to driver detach volume aaf2141e-9057-4904-acfd-5dad001b1254 from mountpoint /dev/vdc
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Attempting to detach device vdc from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:34:43 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:43 user nova-compute[71285]:   <source dev="/dev/sdg"/>
Apr 13 20:34:43 user nova-compute[71285]:   <target dev="vdc" bus="virtio"/>
Apr 13 20:34:43 user nova-compute[71285]:   <serial>aaf2141e-9057-4904-acfd-5dad001b1254</serial>
Apr 13 20:34:43 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 20:34:43 user nova-compute[71285]: </disk>
Apr 13 20:34:43 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:34:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdc from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the persistent domain config.
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:34:43 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:43 user nova-compute[71285]:   <source dev="/dev/sdg"/>
Apr 13 20:34:43 user nova-compute[71285]:   <target dev="vdc" bus="virtio"/>
Apr 13 20:34:43 user nova-compute[71285]:   <serial>aaf2141e-9057-4904-acfd-5dad001b1254</serial>
Apr 13 20:34:43 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 13 20:34:43 user nova-compute[71285]: </disk>
Apr 13 20:34:43 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:34:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.496s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:44 user nova-compute[71285]: INFO nova.compute.manager [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Swapping old allocation on dict_keys(['53cf08c2-ffbf-4a19-b42f-a7314bd542ef']) held by migration 0fac526e-ebd2-4549-b35c-0de461829805 for instance
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Overwriting current allocation {'allocations': {'53cf08c2-ffbf-4a19-b42f-a7314bd542ef': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 38}}, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'user_id': '04d351d2822a460d93748b98161d730c', 'consumer_generation': 1} on consumer b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418084.1407106, 06095354-ac91-443e-8181-dfa44a14ba77 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:34:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully detached device vdc from instance 06095354-ac91-443e-8181-dfa44a14ba77 from the live domain config.
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FQWEtsHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:44 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999774d-4877-4e48-807e-7718e8a9bbaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:34:44 user nova-compute[71285]: No targets found.
Apr 13 20:34:44 user nova-compute[71285]: iSNS:
Apr 13 20:34:44 user nova-compute[71285]: No targets found.
Apr 13 20:34:44 user nova-compute[71285]: STATIC:
Apr 13 20:34:44 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:34:44 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:44 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:44 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254
Apr 13 20:34:44 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:44 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:44 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:34:44 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:44 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:44 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7
Apr 13 20:34:44 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:34:44 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:34:44 user nova-compute[71285]: FIRMWARE:
Apr 13 20:34:44 user nova-compute[71285]: No targets found.
Apr 13 20:34:44 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:34:44 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:34:44 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31616df-c420-49c3-a87f-2cb6def85bf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[adff63d5-9be3-4775-bf7f-90564cd79dc9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:44 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:44 user nova-compute[71285]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 (non-flash)
Apr 13 20:34:44 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a03520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254'): ({'sdg'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Removing single pathed devices sdg {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddb31ce-b8ef-419c-af2c-dfa60c690ad2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e49b6ff-7732-4b25-a51e-da16dc587bfc]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Flushing IO for device /dev/sdg {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1290f86-1600-418c-81ac-539534199469]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3fd360-82cb-4dee-9890-3370f883e458]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] SCSI volumes sdg have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67963a7e-7136-47ef-9013-7d22dfdc74f7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a9eb2-0181-4e43-9797-70b73bb126c5]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260]
Apr 13 20:34:44 user nova-compute[71285]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:44 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aaf2141e-9057-4904-acfd-5dad001b1254 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12897c9-da62-40b7-8bea-fea099fd53e1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] <== disconnect_volume: return (327ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.utils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457be37-8628-4665-bed2-7e4cefb0ab63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd29ffd-07a1-4d49-a68f-059c0bc3a411]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ba858a-bcf2-4a5e-88ed-3ec5e24272e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2fbd1-85d7-4f8a-8d07-e5331ca23025]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:34:44 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:34:44 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd67537-d12d-4a0e-bc65-e95257c50417]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:34:44 user nova-compute[71285]: DEBUG os_brick.utils [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'flavor' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d37d660-07a2-4846-a021-f8e85d4023d7 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.704s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:46 user nova-compute[71285]: INFO nova.compute.manager [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Terminating instance
Apr 13 20:34:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-unplugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] No waiting events found dispatching network-vif-unplugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-e18ded56-4bb4-4cc8-a9f5-2c97edb0fbde req-042bda3c-ce70-4275-af5f-afcc32ecbf59 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-unplugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:34:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Instance destroyed successfully.
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lazy-loading 'resources' on Instance uuid 06095354-ac91-443e-8181-dfa44a14ba77 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-758761895',display_name='tempest-AttachVolumeTestJSON-server-758761895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-758761895',id=28,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxyFfcxKO+lPHZHZA8kfKWxEvzIV81dWX33k2emGB4oNguvST61Qj6LSYBEY1hzgxv/SRx/KGzUsi/U1+Fbxx3iIU9HdkWNMNVlsH3GSLEvkEFJlhr8lbeYflCzZq2JAQ==',key_name='tempest-keypair-677859878',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:32:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='587bca93ee3f45b9b5b1ceb91e972e7b',ramdisk_id='',reservation_id='r-9ny0ok61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1545246928',owner_user_name='tempest-AttachVolumeTestJSON-1545246928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:32:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b5210a73b1574e82838f3f0ccef93a25',uuid=06095354-ac91-443e-8181-dfa44a14ba77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converting VIF {"id": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "address": "fa:16:3e:06:09:84", "network": {"id": "8ae2ae85-3644-4f35-bc04-a6af1ace6265", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1152347684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "587bca93ee3f45b9b5b1ceb91e972e7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c0bbbad-8a", "ovs_interfaceid": "0c0bbbad-8a34-4585-ae25-fbf2e9e42df3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG os_vif [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c0bbbad-8a, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:47 user nova-compute[71285]: INFO os_vif [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:09:84,bridge_name='br-int',has_traffic_filtering=True,id=0c0bbbad-8a34-4585-ae25-fbf2e9e42df3,network=Network(8ae2ae85-3644-4f35-bc04-a6af1ace6265),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c0bbbad-8a')
Apr 13 20:34:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Deleting instance files /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77_del
Apr 13 20:34:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Deletion of /opt/stack/data/nova/instances/06095354-ac91-443e-8181-dfa44a14ba77_del complete
Apr 13 20:34:47 user nova-compute[71285]: INFO nova.compute.manager [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 13 20:34:47 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:47 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Took 0.77 seconds to deallocate network for instance.
Apr 13 20:34:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-44ac9864-63fc-4254-ae51-a400e6aa938e req-c74a2775-26c7-47e9-98b7-7417ba85f8c9 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-deleted-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:48 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Deleted allocations for instance 06095354-ac91-443e-8181-dfa44a14ba77
Apr 13 20:34:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d1e9ac2b-58d3-4ef4-89f9-29973b5237f9 tempest-AttachVolumeTestJSON-1545246928 tempest-AttachVolumeTestJSON-1545246928-project-member] Lock "06095354-ac91-443e-8181-dfa44a14ba77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Acquiring lock "06095354-ac91-443e-8181-dfa44a14ba77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] Lock "06095354-ac91-443e-8181-dfa44a14ba77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] No waiting events found dispatching network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:48 user nova-compute[71285]: WARNING nova.compute.manager [req-43125340-c779-4e1c-941b-7a0ae7e42c61 req-7d8fb053-dd73-45d8-b610-49be11b9a007 service nova] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Received unexpected event network-vif-plugged-0c0bbbad-8a34-4585-ae25-fbf2e9e42df3 for instance with vm_state deleted and task_state None.
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Starting finish_revert_migration {{(pid=71285) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start _get_guest_xml network_info=[{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b8bcf189-a781-474e-bc4f-8a471a661e93', 'attached_at': '2023-04-13T20:34:49.000000', 'detached_at': '', 'volume_id': '69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'serial': '69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb'}, 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'f08c097c-aa8e-4e0b-b721-3bc3ba2f8812', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:34:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:49 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:34:49 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:49 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:34:49 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[749d809d-b51b-40f9-8b33-292180648af0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:34:49 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ca968-0285-4f1d-aa7d-ffc346b79c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb] added
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a6e980-099f-48f0-8df1-8c3de38bc3c4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfe3e4-73c7-4a34-a3ca-1ec56ba1ec0d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlbstDHd" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9503d-c96f-4d9d-9116-6a648dba3942]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UlbstDHd'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac01bd-ae31-45ea-b568-d599402ef7dc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a66415-93fb-4389-a33b-c2fc5534730d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[35881a00-4bad-4c44-aa07-9dfb831d269c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:34:49 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a256095-4cf6-4de0-9fbf-10e5d713dde9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f76685-adbe-4267-ba08-ce314990bb1d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:34:49 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:34:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[da899bb7-3061-41e1-885e-7bd2067b4259]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:34:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532653835356466', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:34:50 user nova-compute[71285]:   <uuid>b8bcf189-a781-474e-bc4f-8a471a661e93</uuid>
Apr 13 20:34:50 user nova-compute[71285]:   <name>instance-00000012</name>
Apr 13 20:34:50 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:34:50 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:34:50 user nova-compute[71285]:   <metadata>
Apr 13 20:34:50 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:34:50 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-181194148</nova:name>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:34:49</nova:creationTime>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:34:50 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:34:50 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:owner>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:34:50 user nova-compute[71285]:       </nova:owner>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:34:50 user nova-compute[71285]:       <nova:ports>
Apr 13 20:34:50 user nova-compute[71285]:         <nova:port uuid="2a0918fa-0318-4cee-aa86-e65201b06aa8">
Apr 13 20:34:50 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 20:34:50 user nova-compute[71285]:         </nova:port>
Apr 13 20:34:50 user nova-compute[71285]:       </nova:ports>
Apr 13 20:34:50 user nova-compute[71285]:     </nova:instance>
Apr 13 20:34:50 user nova-compute[71285]:   </metadata>
Apr 13 20:34:50 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:34:50 user nova-compute[71285]:     <system>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="serial">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="uuid">b8bcf189-a781-474e-bc4f-8a471a661e93</entry>
Apr 13 20:34:50 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:34:50 user nova-compute[71285]:     </system>
Apr 13 20:34:50 user nova-compute[71285]:   </sysinfo>
Apr 13 20:34:50 user nova-compute[71285]:   <os>
Apr 13 20:34:50 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:34:50 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:34:50 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:34:50 user nova-compute[71285]:   </os>
Apr 13 20:34:50 user nova-compute[71285]:   <features>
Apr 13 20:34:50 user nova-compute[71285]:     <acpi/>
Apr 13 20:34:50 user nova-compute[71285]:     <apic/>
Apr 13 20:34:50 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:34:50 user nova-compute[71285]:   </features>
Apr 13 20:34:50 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:34:50 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:34:50 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:34:50 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:34:50 user nova-compute[71285]:   </clock>
Apr 13 20:34:50 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:34:50 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:34:50 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:34:50 user nova-compute[71285]:   </cpu>
Apr 13 20:34:50 user nova-compute[71285]:   <devices>
Apr 13 20:34:50 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:34:50 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:34:50 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk"/>
Apr 13 20:34:50 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:34:50 user nova-compute[71285]:     </disk>
Apr 13 20:34:50 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:34:50 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:34:50 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:34:50 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:34:50 user nova-compute[71285]:       <serial>69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb</serial>
Apr 13 20:34:50 user nova-compute[71285]:     </disk>
Apr 13 20:34:50 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:34:50 user nova-compute[71285]:       <mac address="fa:16:3e:a6:33:90"/>
Apr 13 20:34:50 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:50 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:34:50 user nova-compute[71285]:       <target dev="tap2a0918fa-03"/>
Apr 13 20:34:50 user nova-compute[71285]:     </interface>
Apr 13 20:34:50 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:34:50 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/console.log" append="off"/>
Apr 13 20:34:50 user nova-compute[71285]:     </serial>
Apr 13 20:34:50 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:34:50 user nova-compute[71285]:     <video>
Apr 13 20:34:50 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:34:50 user nova-compute[71285]:     </video>
Apr 13 20:34:50 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:34:50 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:34:50 user nova-compute[71285]:     </rng>
Apr 13 20:34:50 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:34:50 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:34:50 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:34:50 user nova-compute[71285]:     </memballoon>
Apr 13 20:34:50 user nova-compute[71285]:   </devices>
Apr 13 20:34:50 user nova-compute[71285]: </domain>
Apr 13 20:34:50 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:33:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG os_vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a0918fa-03, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a0918fa-03, col_values=(('external_ids', {'iface-id': '2a0918fa-0318-4cee-aa86-e65201b06aa8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:33:90', 'vm-uuid': 'b8bcf189-a781-474e-bc4f-8a471a661e93'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:34:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:50 user nova-compute[71285]: INFO os_vif [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:52 user nova-compute[71285]: WARNING nova.compute.manager [req-9360e6fc-c218-40a7-b6e4-7a6bc9c435a6 req-d7935a9e-6b98-4985-ab03-a500c257fd70 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state resized and task_state resize_reverting.
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:34:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for b8bcf189-a781-474e-bc4f-8a471a661e93 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418094.383804, b8bcf189-a781-474e-bc4f-8a471a661e93 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Resumed (Lifecycle Event)
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance running successfully.
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] finish_revert_migration finished successfully. {{(pid=71285) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418094.3842692, b8bcf189-a781-474e-bc4f-8a471a661e93 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Started (Lifecycle Event)
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:34:54 user nova-compute[71285]: WARNING nova.compute.manager [req-8e3f258b-5209-4cea-860a-32cc1a28cff8 req-69d85c75-c2f7-454c-bc65-371f768c66e0 service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state resized and task_state resize_reverting.
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 13 20:34:54 user nova-compute[71285]: INFO nova.compute.manager [None req-8794ae00-0026-4a42-ad06-21c318e5e702 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance to original state: 'active'
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:34:55 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:55 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7761MB free_disk=26.27092742919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 3e6800d3-8537-4a89-877a-c049f0670590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 858248d1-eefa-462f-a075-078257c736e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0bdf333a-456b-413b-92d6-87e45474905f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:34:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [{"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-b8bcf189-a781-474e-bc4f-8a471a661e93" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:34:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:34:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:34:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:02 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418086.9986274, 06095354-ac91-443e-8181-dfa44a14ba77 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:35:02 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] VM Stopped (Lifecycle Event)
Apr 13 20:35:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-15fe8b0b-0dca-441b-b970-8ef991241615 None None] [instance: 06095354-ac91-443e-8181-dfa44a14ba77] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:35:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:04 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:35:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:10 user nova-compute[71285]: INFO nova.compute.manager [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Terminating instance
Apr 13 20:35:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-unplugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] No waiting events found dispatching network-vif-unplugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-2d66e698-c783-4ffa-9e07-077fe59330e0 req-6d4ebe36-c7e9-4a33-a5c6-73eecb2b044c service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-unplugged-b0bb456d-5327-4938-8949-7c965ee9221d for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Instance destroyed successfully.
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'resources' on Instance uuid a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-517346965',display_name='tempest-VolumesActionsTest-instance-517346965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-517346965',id=29,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:33:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-cqvkuid2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:33:26Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=a2e756a6-be8f-4c1b-a9b0-182d97b8bf33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "b0bb456d-5327-4938-8949-7c965ee9221d", "address": "fa:16:3e:74:37:b8", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bb456d-53", "ovs_interfaceid": "b0bb456d-5327-4938-8949-7c965ee9221d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG os_vif [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0bb456d-53, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:35:11 user nova-compute[71285]: INFO os_vif [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:37:b8,bridge_name='br-int',has_traffic_filtering=True,id=b0bb456d-5327-4938-8949-7c965ee9221d,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bb456d-53')
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Deleting instance files /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33_del
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Deletion of /opt/stack/data/nova/instances/a2e756a6-be8f-4c1b-a9b0-182d97b8bf33_del complete
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.compute.manager [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Took 0.63 seconds to destroy the instance on the hypervisor.
Apr 13 20:35:11 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Took 0.44 seconds to deallocate network for instance.
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-deleted-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:11 user nova-compute[71285]: INFO nova.compute.manager [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Neutron deleted interface b0bb456d-5327-4938-8949-7c965ee9221d; detaching it from the instance and deleting it from the info cache
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG nova.compute.manager [req-3b3bf6c8-1fe9-457a-b90f-e7d3edb5b911 req-122663f3-8075-4031-a987-07661441b548 service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Detach interface failed, port_id=b0bb456d-5327-4938-8949-7c965ee9221d, reason: Instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:12 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:35:12 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:35:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:12 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Deleted allocations for instance a2e756a6-be8f-4c1b-a9b0-182d97b8bf33
Apr 13 20:35:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-bf5626e0-1266-4302-91db-c080c346c978 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.584s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Acquiring lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] Lock "a2e756a6-be8f-4c1b-a9b0-182d97b8bf33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] No waiting events found dispatching network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:13 user nova-compute[71285]: WARNING nova.compute.manager [req-47fbd9e7-85be-4640-87ac-356ba4b03bed req-aadd7837-3cf9-432a-ada4-b79b1a4fdcae service nova] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Received unexpected event network-vif-plugged-b0bb456d-5327-4938-8949-7c965ee9221d for instance with vm_state deleted and task_state None.
Apr 13 20:35:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:35:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 3e6800d3-8537-4a89-877a-c049f0670590 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 5940c278-df77-472e-a32f-e431c5f4b1d1 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "65b84d48-a188-45d4-8720-4036faeaca58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "3e6800d3-8537-4a89-877a-c049f0670590" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "65b84d48-a188-45d4-8720-4036faeaca58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "3e6800d3-8537-4a89-877a-c049f0670590" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:26 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418111.2586324, a2e756a6-be8f-4c1b-a9b0-182d97b8bf33 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:35:26 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] VM Stopped (Lifecycle Event)
Apr 13 20:35:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-fea8bc5c-eb65-4036-989a-1390c2873dc6 None None] [instance: a2e756a6-be8f-4c1b-a9b0-182d97b8bf33] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:35:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:40 user nova-compute[71285]: INFO nova.compute.manager [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Terminating instance
Apr 13 20:35:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-unplugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] No waiting events found dispatching network-vif-unplugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-8712fd02-933b-473c-b1cf-c754752f91b7 req-75918061-4413-4f58-b0fa-09552e51f604 service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-unplugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Instance destroyed successfully.
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid 5940c278-df77-472e-a32f-e431c5f4b1d1 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1920913930',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1920913930',id=30,image_ref='e2252929-c60d-4172-92bf-b4700b193055',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:34:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-cm51v2h0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2040418736',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:34:07Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=5940c278-df77-472e-a32f-e431c5f4b1d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "address": "fa:16:3e:82:d8:34", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0da94b7-24", "ovs_interfaceid": "c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_vif [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0da94b7-24, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:35:41 user nova-compute[71285]: INFO os_vif [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:d8:34,bridge_name='br-int',has_traffic_filtering=True,id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0da94b7-24')
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBkfAWSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:35:41 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[164e69cd-2c49-43da-acd7-6c3966ded7b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:35:41 user nova-compute[71285]: No targets found.
Apr 13 20:35:41 user nova-compute[71285]: iSNS:
Apr 13 20:35:41 user nova-compute[71285]: No targets found.
Apr 13 20:35:41 user nova-compute[71285]: STATIC:
Apr 13 20:35:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:35:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:35:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:35:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:35:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:35:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:35:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:35:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:35:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:35:41 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7
Apr 13 20:35:41 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:35:41 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:35:41 user nova-compute[71285]: FIRMWARE:
Apr 13 20:35:41 user nova-compute[71285]: No targets found.
Apr 13 20:35:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:35:41 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:35:41 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616fc40-e37a-4494-b5ea-b1b01343296c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f23ba9-14b2-4fd2-b591-9df4b35cd4e6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:35:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:35:41 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:35:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70ae6f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcefe67a-0a0d-4f5a-aa5a-08d07eb52be3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a29eb-c3cc-47f2-9c49-277aae74bf0b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ffc192-6dfa-42be-abbe-7b79fde3de17]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b060ba0-ae6f-4578-b17e-9757be5e1703]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23533363638626131', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e429730e', '/dev/disk/by-id/scsi-1SCST_BIOe429730e-53668ba15edf8dc9') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:35:41 user nova-compute[71285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23533363638626131
Apr 13 20:35:41 user nova-compute[71285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_e429730e
Apr 13 20:35:41 user nova-compute[71285]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe429730e-53668ba15edf8dc9
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1330c4cc-0cd2-486c-aa35-ddaa09b298cf]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[160355d2-9ca0-4b86-ba7b-bdacd169b214]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbfe7d2-7913-44d7-b23a-f20ef040f90b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260]
Apr 13 20:35:41 user nova-compute[71285]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7, portal: 172.16.0.220,3260] successful.
Apr 13 20:35:41 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:520625c0-f544-49ca-a9ff-ba010dc0a8d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8980f108-7636-4c47-9141-0de0073ab210]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (338ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:35:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Deleting instance files /opt/stack/data/nova/instances/5940c278-df77-472e-a32f-e431c5f4b1d1_del
Apr 13 20:35:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Deletion of /opt/stack/data/nova/instances/5940c278-df77-472e-a32f-e431c5f4b1d1_del complete
Apr 13 20:35:41 user nova-compute[71285]: INFO nova.compute.manager [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 20:35:41 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:35:41 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:35:42 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Took 0.54 seconds to deallocate network for instance.
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-deleted-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:42 user nova-compute[71285]: INFO nova.compute.manager [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Neutron deleted interface c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf; detaching it from the instance and deleting it from the info cache
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.network.neutron [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-b43c5a8e-0d52-4477-b4f0-21ad0f08c078 req-a4ad5838-e374-478c-b769-7aacdf00cc9a service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Detach interface failed, port_id=c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf, reason: Instance 5940c278-df77-472e-a32f-e431c5f4b1d1 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Acquiring lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] No waiting events found dispatching network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:42 user nova-compute[71285]: WARNING nova.compute.manager [req-86494711-c748-4406-bebb-0096be18e2e9 req-cb0b0d6e-d154-4ec2-810d-ed333545964d service nova] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Received unexpected event network-vif-plugged-c0da94b7-24f9-43c4-9b6a-b7c7aefd9ecf for instance with vm_state active and task_state deleting.
Apr 13 20:35:42 user nova-compute[71285]: INFO nova.compute.manager [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Took 0.87 seconds to detach 1 volumes for instance.
Apr 13 20:35:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Deleting volume: 520625c0-f544-49ca-a9ff-ba010dc0a8d7 {{(pid=71285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 20:35:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:43 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:35:43 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:35:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:43 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance 5940c278-df77-472e-a32f-e431c5f4b1d1
Apr 13 20:35:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5359c6de-f1d0-4668-b174-989ab04bc076 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "5940c278-df77-472e-a32f-e431c5f4b1d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.284s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:49 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418141.0203288, 5940c278-df77-472e-a32f-e431c5f4b1d1 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:35:56 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] VM Stopped (Lifecycle Event)
Apr 13 20:35:56 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:35:56 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=26.28643035888672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-935dd15a-df03-40ec-a34e-21ecab61ce06 None None] [instance: 5940c278-df77-472e-a32f-e431c5f4b1d1] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 3e6800d3-8537-4a89-877a-c049f0670590 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 858248d1-eefa-462f-a075-078257c736e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0bdf333a-456b-413b-92d6-87e45474905f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:35:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:57 user nova-compute[71285]: INFO nova.compute.manager [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Unrescuing
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.network.neutron [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:57 user nova-compute[71285]: INFO nova.compute.manager [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Attaching volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a to /dev/vdb
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b25b0-86e2-4269-a500-b55573e8d648]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d1ded-c5a2-4eb0-8319-ce7185b28bd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23aad8a-03d0-4de1-bed9-80c48530fc06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e897af0-18a4-46ce-9980-a324dddea2bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:35:57 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ced778f-112b-4209-91c7-7dbf46bae852]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating existing volume attachment record: 3a74e320-e4a0-4954-86b1-7a7ba8015637 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:57 user nova-compute[71285]: WARNING nova.compute.manager [req-e7d22cf3-428b-4f0b-9548-8858c964cd3b req-b9c46f29-ebeb-4a43-833a-54f9f1c190fe service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:35:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance destroyed successfully.
Apr 13 20:35:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:35:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:59 user nova-compute[71285]: WARNING nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:35:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:35:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:35:59 user nova-compute[71285]: WARNING nova.compute.manager [req-30cdcfa5-561d-4db5-b94c-bf07d5f06ed8 req-2cc2f0a2-5f64-4f5c-aa2f-c159abb40a6d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:36:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for fd729f88-fb57-4e9b-9cb8-645dcd4ae441 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418161.865082, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:01 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Resumed (Lifecycle Event)
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-38c6b278-33db-4631-98b0-6f51a076aa4d tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:01 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418161.8673062, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:01 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Started (Lifecycle Event)
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:02 user nova-compute[71285]: WARNING nova.compute.manager [req-02cca208-3cc4-4ad8-92b0-0d31fe88fa82 req-bffaa81c-7c4c-4b48-8448-390f23376a2e service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state active and task_state None.
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:36:02 user nova-compute[71285]: INFO nova.compute.claims [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Claim successful on node user
Apr 13 20:36:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPwRLupN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:02 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:02 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:02 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb55612-eafd-43a9-97a0-a2e20e49b7a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:36:02 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[644b86bc-c750-4b19-8d69-0db87733cbb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a] added
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84335fa-d130-4c9b-b555-034433d2f5d5]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef7e0c-6884-422b-acf6-1ae53791c70c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPwRLupN {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPwRLupN" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ac2cd-2c2a-4a74-8eb0-5f7e13ddd5c7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPwRLupN'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:36:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac8d03e-ace7-4986-bf15-eee7ef6e65f8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38673f97-e075-4c7d-9da9-e0dfc27f7c90]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.policy [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3993eb2be0d94cdbb16fd233999fc5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd550373054224fcbbb7300f512ad0345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad1fca-b205-4df8-a38a-74f5006ad1a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260]
Apr 13 20:36:02 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260] successful.
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77de4c04-01fd-4663-a54c-b8a40d8a5291]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:36:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Creating image(s)
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "/opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "/opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c23b805-c833-4190-b7c1-a12473a458e1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:02 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:02 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaaf388-8e89-45e7-9994-6661ffe8490b]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:36:02 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPwRLupN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk 1073741824" returned: 0 in 0.073s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Successfully created port: 7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Cannot resize image /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'migration_context' on Instance uuid ea4eb9e9-983d-4009-8e32-56a4494961c5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Ensure instance console log exists: /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23234373030373833', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234373030373833', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:36:03 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:36:03 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:36:03 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:36:03 user nova-compute[71285]:   <serial>1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a</serial>
Apr 13 20:36:03 user nova-compute[71285]: </disk>
Apr 13 20:36:03 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Successfully updated port: 7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquired lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-changed-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Refreshing instance network info cache due to event network-changed-7f1026a7-0645-4eae-8338-5275284ecf2e. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Acquiring lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] No VIF found with MAC fa:16:3e:0b:28:2f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Updating instance_info_cache with network_info: [{"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Releasing lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Instance network_info: |[{"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f2fc1f5-a38c-4cd5-8315-b1e8f3017fd2 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.100s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Acquired lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Refreshing network info cache for port 7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Start _get_guest_xml network_info=[{"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:36:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-323195761',display_name='tempest-VolumesActionsTest-instance-323195761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-323195761',id=33,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-5st8ocgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:36:03Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=ea4eb9e9-983d-4009-8e32-56a4494961c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'pci_devices' on Instance uuid ea4eb9e9-983d-4009-8e32-56a4494961c5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:36:04 user nova-compute[71285]:   <uuid>ea4eb9e9-983d-4009-8e32-56a4494961c5</uuid>
Apr 13 20:36:04 user nova-compute[71285]:   <name>instance-00000021</name>
Apr 13 20:36:04 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:36:04 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:36:04 user nova-compute[71285]:   <metadata>
Apr 13 20:36:04 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:36:04 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:name>tempest-VolumesActionsTest-instance-323195761</nova:name>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:36:04</nova:creationTime>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:36:04 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:36:04 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:owner>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:user uuid="3993eb2be0d94cdbb16fd233999fc5c2">tempest-VolumesActionsTest-1802743389-project-member</nova:user>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:project uuid="d550373054224fcbbb7300f512ad0345">tempest-VolumesActionsTest-1802743389</nova:project>
Apr 13 20:36:04 user nova-compute[71285]:       </nova:owner>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:36:04 user nova-compute[71285]:       <nova:ports>
Apr 13 20:36:04 user nova-compute[71285]:         <nova:port uuid="7f1026a7-0645-4eae-8338-5275284ecf2e">
Apr 13 20:36:04 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 13 20:36:04 user nova-compute[71285]:         </nova:port>
Apr 13 20:36:04 user nova-compute[71285]:       </nova:ports>
Apr 13 20:36:04 user nova-compute[71285]:     </nova:instance>
Apr 13 20:36:04 user nova-compute[71285]:   </metadata>
Apr 13 20:36:04 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:36:04 user nova-compute[71285]:     <system>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="serial">ea4eb9e9-983d-4009-8e32-56a4494961c5</entry>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="uuid">ea4eb9e9-983d-4009-8e32-56a4494961c5</entry>
Apr 13 20:36:04 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:36:04 user nova-compute[71285]:     </system>
Apr 13 20:36:04 user nova-compute[71285]:   </sysinfo>
Apr 13 20:36:04 user nova-compute[71285]:   <os>
Apr 13 20:36:04 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:36:04 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:36:04 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:36:04 user nova-compute[71285]:   </os>
Apr 13 20:36:04 user nova-compute[71285]:   <features>
Apr 13 20:36:04 user nova-compute[71285]:     <acpi/>
Apr 13 20:36:04 user nova-compute[71285]:     <apic/>
Apr 13 20:36:04 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:36:04 user nova-compute[71285]:   </features>
Apr 13 20:36:04 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:36:04 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:36:04 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:36:04 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:36:04 user nova-compute[71285]:   </clock>
Apr 13 20:36:04 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:36:04 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:36:04 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:36:04 user nova-compute[71285]:   </cpu>
Apr 13 20:36:04 user nova-compute[71285]:   <devices>
Apr 13 20:36:04 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:36:04 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:36:04 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk"/>
Apr 13 20:36:04 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:36:04 user nova-compute[71285]:     </disk>
Apr 13 20:36:04 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:36:04 user nova-compute[71285]:       <mac address="fa:16:3e:4c:50:07"/>
Apr 13 20:36:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:36:04 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:36:04 user nova-compute[71285]:       <target dev="tap7f1026a7-06"/>
Apr 13 20:36:04 user nova-compute[71285]:     </interface>
Apr 13 20:36:04 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:36:04 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/console.log" append="off"/>
Apr 13 20:36:04 user nova-compute[71285]:     </serial>
Apr 13 20:36:04 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:36:04 user nova-compute[71285]:     <video>
Apr 13 20:36:04 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:36:04 user nova-compute[71285]:     </video>
Apr 13 20:36:04 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:36:04 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:36:04 user nova-compute[71285]:     </rng>
Apr 13 20:36:04 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:36:04 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:36:04 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:36:04 user nova-compute[71285]:     </memballoon>
Apr 13 20:36:04 user nova-compute[71285]:   </devices>
Apr 13 20:36:04 user nova-compute[71285]: </domain>
Apr 13 20:36:04 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-323195761',display_name='tempest-VolumesActionsTest-instance-323195761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-323195761',id=33,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-5st8ocgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:36:03Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=ea4eb9e9-983d-4009-8e32-56a4494961c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG os_vif [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f1026a7-06, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f1026a7-06, col_values=(('external_ids', {'iface-id': '7f1026a7-0645-4eae-8338-5275284ecf2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:50:07', 'vm-uuid': 'ea4eb9e9-983d-4009-8e32-56a4494961c5'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:04 user nova-compute[71285]: INFO os_vif [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06')
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] No VIF found with MAC fa:16:3e:4c:50:07, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:36:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Updated VIF entry in instance network info cache for port 7f1026a7-0645-4eae-8338-5275284ecf2e. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:36:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Updating instance_info_cache with network_info: [{"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0444a403-1d95-49e2-bb8d-2bb863467d5c req-51dbb981-910d-4a30-90b9-35c40b721b75 service nova] Releasing lock "refresh_cache-ea4eb9e9-983d-4009-8e32-56a4494961c5" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] No waiting events found dispatching network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:06 user nova-compute[71285]: WARNING nova.compute.manager [req-5400c3b6-449b-45e8-b03b-84b25db4b951 req-61d0dff3-0759-4d1e-896b-9f6c1e2b8ff1 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received unexpected event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e for instance with vm_state building and task_state spawning.
Apr 13 20:36:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418168.5056589, ea4eb9e9-983d-4009-8e32-56a4494961c5 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] VM Resumed (Lifecycle Event)
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Instance spawned successfully.
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418168.5065835, ea4eb9e9-983d-4009-8e32-56a4494961c5 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] VM Started (Lifecycle Event)
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Took 5.78 seconds to spawn the instance on the hypervisor.
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:36:08 user nova-compute[71285]: INFO nova.compute.manager [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Took 6.50 seconds to build instance.
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a4e4cd10-3949-4610-99af-480843f4a9ba tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.610s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] No waiting events found dispatching network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:08 user nova-compute[71285]: WARNING nova.compute.manager [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received unexpected event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e for instance with vm_state active and task_state None.
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing instance network info cache due to event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:36:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updated VIF entry in instance network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:36:09 user nova-compute[71285]: DEBUG nova.network.neutron [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-459bee3e-f2bc-44a6-9cda-6cc6134d6fb0 req-8091f84e-51d3-4177-ac5c-e31f816e1e90 service nova] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing instance network info cache due to event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:10 user nova-compute[71285]: INFO nova.compute.manager [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Rebooting instance
Apr 13 20:36:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updated VIF entry in instance network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-04a15b18-f6b8-4c30-9603-8c2e0cf75f21 req-7a2b699b-0af6-4076-98f6-c2bd8bef9b59 service nova] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:14 user nova-compute[71285]: WARNING nova.compute.manager [req-9ba59e70-8eb2-4565-840b-6946abd5025b req-00a61a46-e166-49a5-9596-db51a7a92cfd service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state active and task_state reboot_started.
Apr 13 20:36:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance shutdown successfully.
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG nova.compute.manager [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:16 user nova-compute[71285]: WARNING nova.compute.manager [req-322f6b48-4543-45c2-9f3a-55f930191bc7 req-3f8a65cb-9946-41df-b822-0999858a10af service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state active and task_state reboot_started.
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:18 user nova-compute[71285]: WARNING nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state active and task_state reboot_started.
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:18 user nova-compute[71285]: WARNING nova.compute.manager [req-2a543916-e383-47b0-912d-66956b19be00 req-2cb6257e-b4d3-4691-9d06-c8cc83523de6 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state active and task_state reboot_started.
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 858248d1-eefa-462f-a075-078257c736e9 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418178.4408386, 858248d1-eefa-462f-a075-078257c736e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:18 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] VM Resumed (Lifecycle Event)
Apr 13 20:36:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance running successfully.
Apr 13 20:36:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance soft rebooted successfully.
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:18 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418178.4451082, 858248d1-eefa-462f-a075-078257c736e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:18 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] VM Started (Lifecycle Event)
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b90f205e-0bde-4213-8093-906b28eb0bc0 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.774s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-changed-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Refreshing instance network info cache due to event network-changed-343a5e66-81f2-407f-a646-cc52fdd762c9. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Acquiring lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Acquired lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Refreshing network info cache for port 343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:36:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updated VIF entry in instance network info cache for port 343a5e66-81f2-407f-a646-cc52fdd762c9. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:36:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updating instance_info_cache with network_info: [{"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a4da7454-729a-4029-9334-ff1e9fef1389 req-37f56483-ac57-4716-a547-06a337e52d9c service nova] Releasing lock "refresh_cache-0bdf333a-456b-413b-92d6-87e45474905f" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:21 user nova-compute[71285]: INFO nova.compute.manager [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Attaching volume 1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 to /dev/vdb
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.utils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea42ec2-1aa9-434b-9f07-fad7817860cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0d0930-a55a-4f27-a5e4-aa05d7d66820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824c4fd-91e9-46e2-8b3b-5fa728111003]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36950de8-c0ba-478c-9b7f-915646e36799]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:36:22 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:36:22 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0d9c3-3a0e-434d-b3ad-58fa4c5a7d8b]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG os_brick.utils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updating existing volume attachment record: c14a2d7c-5b5d-4062-8a19-1904ed644d4e {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:36:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZRCfGas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:26 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:26 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:26 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833a006-fe67-4020-bae1-938c4e4100e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:36:26 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5156a-60ea-4db7-977f-2c5148af71a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6] added
Apr 13 20:36:26 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a2598a-a21c-4018-91f5-37567e915ecd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11b9c63-f30c-4c7f-9dab-fe697d773f58]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZRCfGas {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xZRCfGas" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[004072fe-8f5c-416f-846b-c221e262dac7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xZRCfGas'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[638b5798-b9ce-400b-9b96-9de793f878d4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16346564-0ce8-41cd-903f-7589f2b38888]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --login" returned: 0 in 0.159s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ff51a2-be31-4310-b26d-5773d872f0fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260]
Apr 13 20:36:27 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260] successful.
Apr 13 20:36:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29c7e37-6492-4ffd-a9f4-89e49548f5ed]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316357f-898b-4664-af68-c7f4a9bc2387]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)
Apr 13 20:36:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:27 user nova-compute[71285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)
Apr 13 20:36:27 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.422s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d8fb36-c238-4ad6-8327-f9015c543b9f]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZRCfGas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.478s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '26666346237393065', 'path': '/dev/sdf'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666346237393065', 'path': '/dev/sdf'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:36:28 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:36:28 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:36:28 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:36:28 user nova-compute[71285]:   <serial>1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6</serial>
Apr 13 20:36:28 user nova-compute[71285]: </disk>
Apr 13 20:36:28 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] No VIF found with MAC fa:16:3e:67:46:02, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:36:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c3ff1dbf-2321-422a-9112-f84172db14b0 tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.978s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:29 user nova-compute[71285]: INFO nova.compute.manager [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Detaching volume 1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6
Apr 13 20:36:29 user nova-compute[71285]: INFO nova.virt.block_device [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Attempting to driver detach volume 1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 from mountpoint /dev/vdb
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Attempting to detach device vdb from instance 0bdf333a-456b-413b-92d6-87e45474905f from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:36:30 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:36:30 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:36:30 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:36:30 user nova-compute[71285]:   <serial>1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6</serial>
Apr 13 20:36:30 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:36:30 user nova-compute[71285]: </disk>
Apr 13 20:36:30 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:36:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance 0bdf333a-456b-413b-92d6-87e45474905f from the persistent domain config.
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bdf333a-456b-413b-92d6-87e45474905f from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:36:30 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:36:30 user nova-compute[71285]:   <source dev="/dev/sdf"/>
Apr 13 20:36:30 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:36:30 user nova-compute[71285]:   <serial>1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6</serial>
Apr 13 20:36:30 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:36:30 user nova-compute[71285]: </disk>
Apr 13 20:36:30 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418190.4698014, 0bdf333a-456b-413b-92d6-87e45474905f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:36:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully detached device vdb from instance 0bdf333a-456b-413b-92d6-87e45474905f from the live domain config.
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xZRCfGas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9c777e-3746-4ca9-9501-0601db3d7b7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:36:30 user nova-compute[71285]: No targets found.
Apr 13 20:36:30 user nova-compute[71285]: iSNS:
Apr 13 20:36:30 user nova-compute[71285]: No targets found.
Apr 13 20:36:30 user nova-compute[71285]: STATIC:
Apr 13 20:36:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:36:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:36:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6
Apr 13 20:36:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:36:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:36:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:30 user nova-compute[71285]: FIRMWARE:
Apr 13 20:36:30 user nova-compute[71285]: No targets found.
Apr 13 20:36:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:36:30 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:36:30 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18c90bb-428d-49a0-8134-cb8acac04619]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b1ebb-89a9-4c87-8474-c7e8c889bd1b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)
Apr 13 20:36:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:30 user nova-compute[71285]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 (non-flash)
Apr 13 20:36:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a00820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6'): ({'sdf'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Removing single pathed devices sdf {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada0a58-7b46-44ed-9755-079f9e4f4a4b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad0a71a-8af5-451b-b460-a2fa4764036e]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Flushing IO for device /dev/sdf {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c25cef-16c7-4be1-a9e0-1f448529f4dd]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f5967-80b3-4e40-a0be-bbe9ae9c6732]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] SCSI volumes sdf have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9feedc-8832-435f-b142-2cb0834b901c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6276cf18-204b-4fef-9b4a-bb06321431c2]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260]
Apr 13 20:36:30 user nova-compute[71285]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6, portal: 172.16.0.220,3260] successful.
Apr 13 20:36:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a153c99-1b2e-400b-ac1c-c8d4cb7f0ad6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c084c-3a11-4f18-9418-e93690d5fd19]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] <== disconnect_volume: return (341ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:36:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:32 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'flavor' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5f8181db-e5ca-44de-a3e3-ad64638656ca tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.558s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:35 user nova-compute[71285]: INFO nova.compute.manager [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Terminating instance
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-unplugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] No waiting events found dispatching network-vif-unplugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-351b78c0-dbfe-46f5-ba59-f156f381502d req-aedb7e43-1f93-430a-9d66-01f03a27d0c8 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-unplugged-d4d99364-e2da-4757-ab7c-38f903f15a19 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:36:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Instance destroyed successfully.
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid 3e6800d3-8537-4a89-877a-c049f0670590 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-704536365',display_name='tempest-TestVolumeBootPattern-volume-backed-server-704536365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-704536365',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-3rfee89h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:32:07Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=3e6800d3-8537-4a89-877a-c049f0670590,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "d4d99364-e2da-4757-ab7c-38f903f15a19", "address": "fa:16:3e:a9:1a:91", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d99364-e2", "ovs_interfaceid": "d4d99364-e2da-4757-ab7c-38f903f15a19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_vif [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d99364-e2, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:36:35 user nova-compute[71285]: INFO os_vif [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1a:91,bridge_name='br-int',has_traffic_filtering=True,id=d4d99364-e2da-4757-ab7c-38f903f15a19,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d99364-e2')
Apr 13 20:36:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbQqBEXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:35 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b5f668-5f95-49b3-b776-ed10237191ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:36:35 user nova-compute[71285]: No targets found.
Apr 13 20:36:35 user nova-compute[71285]: iSNS:
Apr 13 20:36:35 user nova-compute[71285]: No targets found.
Apr 13 20:36:35 user nova-compute[71285]: STATIC:
Apr 13 20:36:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac
Apr 13 20:36:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:36:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:36:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:35 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:36:35 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:36:35 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:36:35 user nova-compute[71285]: FIRMWARE:
Apr 13 20:36:35 user nova-compute[71285]: No targets found.
Apr 13 20:36:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:36:35 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:36:35 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecc64c-fba1-4b71-ab02-22788d3424fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2348047-8a12-4171-bf6e-ceef2927818d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:35 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc387b48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73bd035-e931-4c5e-bc8d-dae28f69db0f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf73817c-fd55-496a-8a22-970511d9c045]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90fe18-7641-4320-9051-a5974c727d0b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ac1ca-76fb-4e9a-98a1-64d12fc1de9b]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7054f7e2', '/dev/disk/by-id/scsi-23363643036613632', '/dev/disk/by-id/scsi-1SCST_BIO7054f7e2-3cd06a62ea781832') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e4e5c-61ce-432d-a251-b9fe7ab14c74]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[412d7c4b-fa10-4015-9cfe-1b6d3b3f82db]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b163e68-2a0d-4d92-9fae-b9d870d50bff]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260]
Apr 13 20:36:36 user nova-compute[71285]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac, portal: 172.16.0.220,3260] successful.
Apr 13 20:36:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b663208-c712-444c-9d05-1b84e247c6ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc311788-261f-4ede-9474-eb81cff7b6a3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (327ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:36:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Deleting instance files /opt/stack/data/nova/instances/3e6800d3-8537-4a89-877a-c049f0670590_del
Apr 13 20:36:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Deletion of /opt/stack/data/nova/instances/3e6800d3-8537-4a89-877a-c049f0670590_del complete
Apr 13 20:36:36 user nova-compute[71285]: INFO nova.compute.manager [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 13 20:36:36 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:36 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Took 0.75 seconds to deallocate network for instance.
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-deleted-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:36 user nova-compute[71285]: INFO nova.compute.manager [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Neutron deleted interface d4d99364-e2da-4757-ab7c-38f903f15a19; detaching it from the instance and deleting it from the info cache
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.network.neutron [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-89053681-ee9e-49a2-8ca1-315f875dc8df req-ab9c073c-dd0a-489a-a72f-a48a9fe7d551 service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Detach interface failed, port_id=d4d99364-e2da-4757-ab7c-38f903f15a19, reason: Instance 3e6800d3-8537-4a89-877a-c049f0670590 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:36:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Acquiring lock "3e6800d3-8537-4a89-877a-c049f0670590-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] Lock "3e6800d3-8537-4a89-877a-c049f0670590-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] No waiting events found dispatching network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:37 user nova-compute[71285]: WARNING nova.compute.manager [req-33e20894-a5e3-4bea-b708-10fdc71eaf3b req-2976de82-1c91-4924-ae58-58d04234870d service nova] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Received unexpected event network-vif-plugged-d4d99364-e2da-4757-ab7c-38f903f15a19 for instance with vm_state active and task_state deleting.
Apr 13 20:36:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:38 user nova-compute[71285]: INFO nova.compute.manager [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Took 1.69 seconds to detach 1 volumes for instance.
Apr 13 20:36:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Deleting volume: 2b663208-c712-444c-9d05-1b84e247c6ac {{(pid=71285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 20:36:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:39 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:36:39 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:36:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:39 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance 3e6800d3-8537-4a89-877a-c049f0670590
Apr 13 20:36:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e613e7c2-0739-4353-82e3-35297cfe994a tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "3e6800d3-8537-4a89-877a-c049f0670590" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.164s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:36:41 user nova-compute[71285]: INFO nova.compute.claims [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Claim successful on node user
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:36:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:36:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:36:42 user nova-compute[71285]: INFO nova.virt.block_device [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Booting with volume 7127ca39-0a83-4dda-a67e-4630b25fd4a1 at /dev/vda
Apr 13 20:36:42 user nova-compute[71285]: DEBUG nova.policy [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99bfa0ed895e4574a3e0532e588ca74a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0749bcd26454f179454d9f9cacbfbdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.utils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27685dfe-9141-42e9-aa4b-7136234f11b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e783b10d-ed0e-455c-ad71-6c3981c2c003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f68c4-a9fc-4e50-97e1-ff6e99521a72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80134091-f09e-488c-a7b7-31d844fe5c81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:36:42 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:36:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[faff9498-d8fd-4da7-8f8e-75f73ea7675c]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG os_brick.utils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating existing volume attachment record: 6a25ce2a-f430-4668-975a-9aa24f0e6c07 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Successfully created port: aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Successfully updated port: aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing instance network info cache due to event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:43 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance network_info: |[{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updated VIF entry in instance network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG nova.network.neutron [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-71d73c9e-df23-4105-b101-edc34774cbc0 req-6315ff88-5b00-4fde-8fed-60cc00e084e8 service nova] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:36:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Creating image(s)
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Ensure instance console log exists: /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start _get_guest_xml network_info=[{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4bb153e2-7b64-4495-8b9d-24be34497c37', 'attached_at': '', 'detached_at': '', 'volume_id': '7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'serial': '7127ca39-0a83-4dda-a67e-4630b25fd4a1'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '6a25ce2a-f430-4668-975a-9aa24f0e6c07', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:36:47 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:47 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:36:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:36:47 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7d793e-0c1b-4fa6-9ea2-91f83f3c373a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:36:47 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[880e4ecf-6299-442e-9ee8-694c6ad2a6f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1] added
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ee5a7b-f3ab-41c2-bd88-9a7f92f3a096]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27199d5d-7626-4b5d-beef-5b33b5cd4ab1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pguOUwFJ {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pguOUwFJ" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2d6279-b9ad-4524-acb8-e8735a6ab463]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pguOUwFJ'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3115f703-eaec-4f97-9809-4ddec6bdd9f1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[449e7ae9-25f0-4cb4-9c08-9a8c11d20683]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8ad78-4e56-4226-9e89-3ddd6a703d00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]
Apr 13 20:36:47 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7c0e05-88f2-46ce-b140-325a3aaceea1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f46041-60f1-4986-9d03-9771bb427281]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:36:47 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:36:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b4016d-e11c-4a3d-b680-98ac56a75501]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:36:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23138636338633830', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138636338633830', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnZUWq96lLQWm647DGAaRq6+rWKgdmIWyN/Z8MUSyiSM9qp5+NoLJa0pen2ZdlQna4LIuZyhqJfhQ+SDeG8Acqb8lYZOWAIaEsWHKVjuYIBLdCciq2oo0X92SlPcgzf2Q==',key_name='tempest-TestShelveInstance-455469676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:36:42Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:36:48 user nova-compute[71285]:   <uuid>4bb153e2-7b64-4495-8b9d-24be34497c37</uuid>
Apr 13 20:36:48 user nova-compute[71285]:   <name>instance-00000022</name>
Apr 13 20:36:48 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:36:48 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:36:48 user nova-compute[71285]:   <metadata>
Apr 13 20:36:48 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:36:48 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:36:48 user nova-compute[71285]:       <nova:name>tempest-TestShelveInstance-server-2081085367</nova:name>
Apr 13 20:36:48 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:36:47</nova:creationTime>
Apr 13 20:36:48 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:36:48 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:36:48 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:36:48 user nova-compute[71285]:       <nova:owner>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:user uuid="99bfa0ed895e4574a3e0532e588ca74a">tempest-TestShelveInstance-1339516766-project-member</nova:user>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:project uuid="e0749bcd26454f179454d9f9cacbfbdb">tempest-TestShelveInstance-1339516766</nova:project>
Apr 13 20:36:48 user nova-compute[71285]:       </nova:owner>
Apr 13 20:36:48 user nova-compute[71285]:       <nova:ports>
Apr 13 20:36:48 user nova-compute[71285]:         <nova:port uuid="aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f">
Apr 13 20:36:48 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 20:36:48 user nova-compute[71285]:         </nova:port>
Apr 13 20:36:48 user nova-compute[71285]:       </nova:ports>
Apr 13 20:36:48 user nova-compute[71285]:     </nova:instance>
Apr 13 20:36:48 user nova-compute[71285]:   </metadata>
Apr 13 20:36:48 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:36:48 user nova-compute[71285]:     <system>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="serial">4bb153e2-7b64-4495-8b9d-24be34497c37</entry>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="uuid">4bb153e2-7b64-4495-8b9d-24be34497c37</entry>
Apr 13 20:36:48 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:36:48 user nova-compute[71285]:     </system>
Apr 13 20:36:48 user nova-compute[71285]:   </sysinfo>
Apr 13 20:36:48 user nova-compute[71285]:   <os>
Apr 13 20:36:48 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:36:48 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:36:48 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:36:48 user nova-compute[71285]:   </os>
Apr 13 20:36:48 user nova-compute[71285]:   <features>
Apr 13 20:36:48 user nova-compute[71285]:     <acpi/>
Apr 13 20:36:48 user nova-compute[71285]:     <apic/>
Apr 13 20:36:48 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:36:48 user nova-compute[71285]:   </features>
Apr 13 20:36:48 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:36:48 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:36:48 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:36:48 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:36:48 user nova-compute[71285]:   </clock>
Apr 13 20:36:48 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:36:48 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:36:48 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:36:48 user nova-compute[71285]:   </cpu>
Apr 13 20:36:48 user nova-compute[71285]:   <devices>
Apr 13 20:36:48 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:36:48 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:36:48 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:36:48 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:36:48 user nova-compute[71285]:       <serial>7127ca39-0a83-4dda-a67e-4630b25fd4a1</serial>
Apr 13 20:36:48 user nova-compute[71285]:     </disk>
Apr 13 20:36:48 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:36:48 user nova-compute[71285]:       <mac address="fa:16:3e:3e:6d:19"/>
Apr 13 20:36:48 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:36:48 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:36:48 user nova-compute[71285]:       <target dev="tapaaa20ef3-4f"/>
Apr 13 20:36:48 user nova-compute[71285]:     </interface>
Apr 13 20:36:48 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:36:48 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37/console.log" append="off"/>
Apr 13 20:36:48 user nova-compute[71285]:     </serial>
Apr 13 20:36:48 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:36:48 user nova-compute[71285]:     <video>
Apr 13 20:36:48 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:36:48 user nova-compute[71285]:     </video>
Apr 13 20:36:48 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:36:48 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:36:48 user nova-compute[71285]:     </rng>
Apr 13 20:36:48 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:36:48 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:36:48 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:36:48 user nova-compute[71285]:     </memballoon>
Apr 13 20:36:48 user nova-compute[71285]:   </devices>
Apr 13 20:36:48 user nova-compute[71285]: </domain>
Apr 13 20:36:48 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnZUWq96lLQWm647DGAaRq6+rWKgdmIWyN/Z8MUSyiSM9qp5+NoLJa0pen2ZdlQna4LIuZyhqJfhQ+SDeG8Acqb8lYZOWAIaEsWHKVjuYIBLdCciq2oo0X92SlPcgzf2Q==',key_name='tempest-TestShelveInstance-455469676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:36:42Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG os_vif [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaa20ef3-4f, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaaa20ef3-4f, col_values=(('external_ids', {'iface-id': 'aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:6d:19', 'vm-uuid': '4bb153e2-7b64-4495-8b9d-24be34497c37'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:48 user nova-compute[71285]: INFO os_vif [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f')
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:36:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] No VIF found with MAC fa:16:3e:3e:6d:19, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:50 user nova-compute[71285]: WARNING nova.compute.manager [req-13731f08-0815-44f7-9f77-494a01cafc44 req-6646d89f-2fff-4b1f-8bfc-479f333d900c service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state building and task_state spawning.
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:50 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418195.741238, 3e6800d3-8537-4a89-877a-c049f0670590 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:50 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] VM Stopped (Lifecycle Event)
Apr 13 20:36:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8197bbaf-4b25-451c-ad67-6fb34f1c2808 None None] [instance: 3e6800d3-8537-4a89-877a-c049f0670590] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418212.1904912, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Resumed (Lifecycle Event)
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance spawned successfully.
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418212.1964376, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Started (Lifecycle Event)
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:36:52 user nova-compute[71285]: WARNING nova.compute.manager [req-3fd63933-8e1f-4aa6-af72-b505d8c75849 req-891000d6-a2ef-498c-b4a5-c77d3e9b1d65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state building and task_state spawning.
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Took 5.21 seconds to spawn the instance on the hypervisor.
Apr 13 20:36:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:36:52 user nova-compute[71285]: INFO nova.compute.manager [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Took 10.92 seconds to build instance.
Apr 13 20:36:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c295736b-720b-4ada-ab4b-e92106bec0d7 tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.020s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:36:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:36:57 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:57 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=7846MB free_disk=26.27075958251953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance b8bcf189-a781-474e-bc4f-8a471a661e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 858248d1-eefa-462f-a075-078257c736e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0bdf333a-456b-413b-92d6-87e45474905f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ea4eb9e9-983d-4009-8e32-56a4494961c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:36:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:36:58 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:36:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:37:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:20 user nova-compute[71285]: INFO nova.compute.manager [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Terminating instance
Apr 13 20:37:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-unplugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] No waiting events found dispatching network-vif-unplugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-cddb3e7f-4eee-4e09-96fc-dadb5f2a4e93 req-b05593d8-cce4-4101-85df-55e1c474e662 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-unplugged-343a5e66-81f2-407f-a646-cc52fdd762c9 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:37:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Instance destroyed successfully.
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lazy-loading 'resources' on Instance uuid 0bdf333a-456b-413b-92d6-87e45474905f {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-75809090',display_name='tempest-AttachVolumeNegativeTest-server-75809090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-75809090',id=32,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLkeyqTPZ9zMzp+K2DjCVHK8Fa3GGyXnf4flHRT96cr2jBUu9eu68fMFegiIQxTphtLwZPA9dzZOUnzKCoaFrpSY4Hb/zRUN5ub6MdFNW63YZDvgRb0mWJ8/YIj66OtXQ==',key_name='tempest-keypair-1660813888',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='053f656470d94d2a9140f393bad01000',ramdisk_id='',reservation_id='r-w315csk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1371087403',owner_user_name='tempest-AttachVolumeNegativeTest-1371087403-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49383d6f0e7141548370d8bc3b96dfd9',uuid=0bdf333a-456b-413b-92d6-87e45474905f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converting VIF {"id": "343a5e66-81f2-407f-a646-cc52fdd762c9", "address": "fa:16:3e:67:46:02", "network": {"id": "4a18c4c0-217f-4ba3-96d6-c37b108efca9", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-270321494-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "053f656470d94d2a9140f393bad01000", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap343a5e66-81", "ovs_interfaceid": "343a5e66-81f2-407f-a646-cc52fdd762c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG os_vif [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap343a5e66-81, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:21 user nova-compute[71285]: INFO os_vif [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:46:02,bridge_name='br-int',has_traffic_filtering=True,id=343a5e66-81f2-407f-a646-cc52fdd762c9,network=Network(4a18c4c0-217f-4ba3-96d6-c37b108efca9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap343a5e66-81')
Apr 13 20:37:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Deleting instance files /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f_del
Apr 13 20:37:21 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Deletion of /opt/stack/data/nova/instances/0bdf333a-456b-413b-92d6-87e45474905f_del complete
Apr 13 20:37:21 user nova-compute[71285]: INFO nova.compute.manager [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 20:37:21 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:37:21 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:22 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Took 0.81 seconds to deallocate network for instance.
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:22 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Deleted allocations for instance 0bdf333a-456b-413b-92d6-87e45474905f
Apr 13 20:37:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-16fc5018-1819-41c4-88ad-fa90948899bf tempest-AttachVolumeNegativeTest-1371087403 tempest-AttachVolumeNegativeTest-1371087403-project-member] Lock "0bdf333a-456b-413b-92d6-87e45474905f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Acquiring lock "0bdf333a-456b-413b-92d6-87e45474905f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] Lock "0bdf333a-456b-413b-92d6-87e45474905f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] No waiting events found dispatching network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:22 user nova-compute[71285]: WARNING nova.compute.manager [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received unexpected event network-vif-plugged-343a5e66-81f2-407f-a646-cc52fdd762c9 for instance with vm_state deleted and task_state None.
Apr 13 20:37:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-dcbba733-ce2b-4116-a5c4-d7c3f564e15e req-7ae480e8-563c-4023-86f6-d5c20d2d07d6 service nova] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Received event network-vif-deleted-343a5e66-81f2-407f-a646-cc52fdd762c9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:37:31 user nova-compute[71285]: INFO nova.compute.claims [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Claim successful on node user
Apr 13 20:37:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:37:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:37:31 user nova-compute[71285]: INFO nova.virt.block_device [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Booting with volume 45e7808c-5141-44a8-bdae-b556a6b5578c at /dev/vda
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.policy [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.utils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc977d-196b-4c56-ae29-74e9aaee9390]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd60bd-eb54-481f-925d-b385ff463303]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8863325f-792a-43da-85ac-cbffb1641f22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503f27d-ba38-4376-9de5-eaa89a0c8d5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:37:31 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88cb124-852e-4082-a385-222c471e833b]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG os_brick.utils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updating existing volume attachment record: 1c284680-abf7-4691-a935-b3f8d4e95196 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:31 user nova-compute[71285]: INFO nova.compute.manager [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Terminating instance
Apr 13 20:37:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-52ac78e4-8dff-4f85-926b-4a7b5717fd0d req-3eeb0177-2dd7-43d6-b8c9-55bae1d42c1e service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-unplugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:32 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Instance destroyed successfully.
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid b8bcf189-a781-474e-bc4f-8a471a661e93 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:24:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-80955434',display_name='tempest-ServerActionsTestJSON-server-181194148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-80955434',id=18,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:34:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-9u59cna8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:34:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=b8bcf189-a781-474e-bc4f-8a471a661e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "address": "fa:16:3e:a6:33:90", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a0918fa-03", "ovs_interfaceid": "2a0918fa-0318-4cee-aa86-e65201b06aa8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_vif [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a0918fa-03, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:32 user nova-compute[71285]: INFO os_vif [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:33:90,bridge_name='br-int',has_traffic_filtering=True,id=2a0918fa-0318-4cee-aa86-e65201b06aa8,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a0918fa-03')
Apr 13 20:37:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlbstDHd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:37:32 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a455fab-badf-45d1-af16-ef7e0c7803da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:37:32 user nova-compute[71285]: No targets found.
Apr 13 20:37:32 user nova-compute[71285]: iSNS:
Apr 13 20:37:32 user nova-compute[71285]: No targets found.
Apr 13 20:37:32 user nova-compute[71285]: STATIC:
Apr 13 20:37:32 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb
Apr 13 20:37:32 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:32 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:32 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:37:32 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:32 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:32 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:37:32 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:32 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:32 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:37:32 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:32 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:32 user nova-compute[71285]: FIRMWARE:
Apr 13 20:37:32 user nova-compute[71285]: No targets found.
Apr 13 20:37:32 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:37:32 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:37:32 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e835fc9-261f-4c13-b2c5-e697e5ce58d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58cf2d8-6612-4773-806f-613f67460327]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:32 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:32 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:32 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a3a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[996886a4-628a-4703-b9e7-f08e5891148d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa5973-ff05-46df-a608-350cb98c38bf]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de05269-6ac3-4b29-abb1-9721afe71d85]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884c2d7-bd75-4b7d-911c-3fcbf543bbdf]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[99237d5a-6c29-4843-929f-dfa61d54f0a6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[932577f7-4bd9-4105-868c-3d7ed18392c0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260]
Apr 13 20:37:33 user nova-compute[71285]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb, portal: 172.16.0.220,3260] successful.
Apr 13 20:37:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Successfully created port: 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69b9e013-d3e5-4574-9dc0-ad2d6bf10aeb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcee855-690f-457e-858f-3e66b4045d54]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (388ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:37:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Deleting instance files /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_del
Apr 13 20:37:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Deletion of /opt/stack/data/nova/instances/b8bcf189-a781-474e-bc4f-8a471a661e93_del complete
Apr 13 20:37:33 user nova-compute[71285]: INFO nova.compute.manager [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Took 1.36 seconds to destroy the instance on the hypervisor.
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Successfully updated port: 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-changed-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Refreshing instance network info cache due to event network-changed-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Acquiring lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:37:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:34 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Took 0.99 seconds to deallocate network for instance.
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-deleted-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:34 user nova-compute[71285]: INFO nova.compute.manager [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Neutron deleted interface 2a0918fa-0318-4cee-aa86-e65201b06aa8; detaching it from the instance and deleting it from the info cache
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-610bd8cb-6c94-4976-b587-fb3d7a5a263e req-34c4d70b-c2eb-4006-98e7-7c3f273d6b7f service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Detach interface failed, port_id=2a0918fa-0318-4cee-aa86-e65201b06aa8, reason: Instance b8bcf189-a781-474e-bc4f-8a471a661e93 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Acquiring lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] No waiting events found dispatching network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:34 user nova-compute[71285]: WARNING nova.compute.manager [req-817f56e1-4f22-4075-9aa9-d5b36895e92e req-960add5b-ec41-465b-848e-1c6fe32e5eae service nova] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Received unexpected event network-vif-plugged-2a0918fa-0318-4cee-aa86-e65201b06aa8 for instance with vm_state active and task_state deleting.
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updating instance_info_cache with network_info: [{"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Instance network_info: |[{"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Acquired lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:37:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Refreshing network info cache for port 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:37:35 user nova-compute[71285]: INFO nova.compute.manager [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Took 0.89 seconds to detach 1 volumes for instance.
Apr 13 20:37:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.303s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:35 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Deleted allocations for instance b8bcf189-a781-474e-bc4f-8a471a661e93
Apr 13 20:37:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e03db74-f031-445b-a82d-95a62829e8a2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "b8bcf189-a781-474e-bc4f-8a471a661e93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.729s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG nova.network.neutron [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updated VIF entry in instance network info cache for port 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG nova.network.neutron [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updating instance_info_cache with network_info: [{"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-23d100f3-dc15-41cd-8ebd-1b248c46b596 req-43f8b15d-a575-46c8-b359-493377a579cf service nova] Releasing lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418241.1376572, 0bdf333a-456b-413b-92d6-87e45474905f => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:37:36 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] VM Stopped (Lifecycle Event)
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-029752b7-41e6-49f2-ae0b-21867be2de7e None None] [instance: 0bdf333a-456b-413b-92d6-87e45474905f] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:37:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Creating image(s)
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Ensure instance console log exists: /opt/stack/data/nova/instances/6c4d5801-3b71-4ce3-83b9-9bf54507c444/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Start _get_guest_xml network_info=[{"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c4d5801-3b71-4ce3-83b9-9bf54507c444', 'attached_at': '', 'detached_at': '', 'volume_id': '45e7808c-5141-44a8-bdae-b556a6b5578c', 'serial': '45e7808c-5141-44a8-bdae-b556a6b5578c'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '1c284680-abf7-4691-a935-b3f8d4e95196', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:37:36 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:37:36 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:37:36 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:37:36 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:37:36 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0dc36d-e838-464d-858a-d8267c0d47e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:37:36 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[133c3538-b2cd-47ba-b5bc-a2d07ecb3646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c] added
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f8e1fa-21f6-4305-93c9-e34331896e83]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a696867-8880-40ae-8f8d-49d53ff5eea7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFHCWQaY {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFHCWQaY" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ee4b3-f748-4248-8d0d-6c692a1ff89a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFHCWQaY'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f164c0-a7fe-4180-99ce-bdf26acf3a38]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3176aa0-da35-4de6-9f07-c4c0cd3c1a00]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b9d314-f637-4a6d-a586-12605d54e5fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]
Apr 13 20:37:36 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[801cba2b-6a96-44aa-a8f9-584f82bcd532]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9571ec70-eddb-4149-b9a8-165b667372b4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:36 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:37:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5cdbca-94ea-4b84-8ab8-e5395aef876a]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:37:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23565393834343862', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565393834343862', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1706849453',display_name='tempest-TestVolumeBootPattern-server-1706849453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1706849453',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-mx8tvwtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:37:31Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=6c4d5801-3b71-4ce3-83b9-9bf54507c444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c4d5801-3b71-4ce3-83b9-9bf54507c444 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:37:37 user nova-compute[71285]:   <uuid>6c4d5801-3b71-4ce3-83b9-9bf54507c444</uuid>
Apr 13 20:37:37 user nova-compute[71285]:   <name>instance-00000023</name>
Apr 13 20:37:37 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:37:37 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:37:37 user nova-compute[71285]:   <metadata>
Apr 13 20:37:37 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:37:37 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:37:37 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-server-1706849453</nova:name>
Apr 13 20:37:37 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:37:36</nova:creationTime>
Apr 13 20:37:37 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:37:37 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:37:37 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:37:37 user nova-compute[71285]:       <nova:owner>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:37:37 user nova-compute[71285]:       </nova:owner>
Apr 13 20:37:37 user nova-compute[71285]:       <nova:ports>
Apr 13 20:37:37 user nova-compute[71285]:         <nova:port uuid="9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc">
Apr 13 20:37:37 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:37:37 user nova-compute[71285]:         </nova:port>
Apr 13 20:37:37 user nova-compute[71285]:       </nova:ports>
Apr 13 20:37:37 user nova-compute[71285]:     </nova:instance>
Apr 13 20:37:37 user nova-compute[71285]:   </metadata>
Apr 13 20:37:37 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:37:37 user nova-compute[71285]:     <system>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="serial">6c4d5801-3b71-4ce3-83b9-9bf54507c444</entry>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="uuid">6c4d5801-3b71-4ce3-83b9-9bf54507c444</entry>
Apr 13 20:37:37 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:37:37 user nova-compute[71285]:     </system>
Apr 13 20:37:37 user nova-compute[71285]:   </sysinfo>
Apr 13 20:37:37 user nova-compute[71285]:   <os>
Apr 13 20:37:37 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:37:37 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:37:37 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:37:37 user nova-compute[71285]:   </os>
Apr 13 20:37:37 user nova-compute[71285]:   <features>
Apr 13 20:37:37 user nova-compute[71285]:     <acpi/>
Apr 13 20:37:37 user nova-compute[71285]:     <apic/>
Apr 13 20:37:37 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:37:37 user nova-compute[71285]:   </features>
Apr 13 20:37:37 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:37:37 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:37:37 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:37:37 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:37:37 user nova-compute[71285]:   </clock>
Apr 13 20:37:37 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:37:37 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:37:37 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:37:37 user nova-compute[71285]:   </cpu>
Apr 13 20:37:37 user nova-compute[71285]:   <devices>
Apr 13 20:37:37 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:37:37 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:37:37 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:37:37 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:37:37 user nova-compute[71285]:       <serial>45e7808c-5141-44a8-bdae-b556a6b5578c</serial>
Apr 13 20:37:37 user nova-compute[71285]:     </disk>
Apr 13 20:37:37 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:37:37 user nova-compute[71285]:       <mac address="fa:16:3e:b1:0b:75"/>
Apr 13 20:37:37 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:37:37 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:37:37 user nova-compute[71285]:       <target dev="tap9144b471-9a"/>
Apr 13 20:37:37 user nova-compute[71285]:     </interface>
Apr 13 20:37:37 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:37:37 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/6c4d5801-3b71-4ce3-83b9-9bf54507c444/console.log" append="off"/>
Apr 13 20:37:37 user nova-compute[71285]:     </serial>
Apr 13 20:37:37 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:37:37 user nova-compute[71285]:     <video>
Apr 13 20:37:37 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:37:37 user nova-compute[71285]:     </video>
Apr 13 20:37:37 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:37:37 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:37:37 user nova-compute[71285]:     </rng>
Apr 13 20:37:37 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:37:37 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:37:37 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:37:37 user nova-compute[71285]:     </memballoon>
Apr 13 20:37:37 user nova-compute[71285]:   </devices>
Apr 13 20:37:37 user nova-compute[71285]: </domain>
Apr 13 20:37:37 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1706849453',display_name='tempest-TestVolumeBootPattern-server-1706849453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1706849453',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-mx8tvwtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:37:31Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=6c4d5801-3b71-4ce3-83b9-9bf54507c444,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG os_vif [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9144b471-9a, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9144b471-9a, col_values=(('external_ids', {'iface-id': '9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:0b:75', 'vm-uuid': '6c4d5801-3b71-4ce3-83b9-9bf54507c444'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:37 user nova-compute[71285]: INFO os_vif [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a')
Apr 13 20:37:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:37:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:b1:0b:75, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] No waiting events found dispatching network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:39 user nova-compute[71285]: WARNING nova.compute.manager [req-00d4169e-0d02-4f14-b3ab-6be2623e0e73 req-d64b0c04-d55f-42c5-9d39-d3d7ea94b10c service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received unexpected event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance with vm_state building and task_state spawning.
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418261.3489647, 6c4d5801-3b71-4ce3-83b9-9bf54507c444 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] VM Resumed (Lifecycle Event)
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Instance spawned successfully.
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418261.352482, 6c4d5801-3b71-4ce3-83b9-9bf54507c444 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] VM Started (Lifecycle Event)
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Took 4.94 seconds to spawn the instance on the hypervisor.
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] No waiting events found dispatching network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:41 user nova-compute[71285]: WARNING nova.compute.manager [req-2b8f92bb-a6ab-475e-ad1e-4f8b16921167 req-22d94527-1c21-4ff7-9b22-3deec47d6101 service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received unexpected event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance with vm_state building and task_state spawning.
Apr 13 20:37:41 user nova-compute[71285]: INFO nova.compute.manager [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Took 10.56 seconds to build instance.
Apr 13 20:37:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a18ed97c-d41d-439e-9c50-7f02759405ea tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.653s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418252.5944378, b8bcf189-a781-474e-bc4f-8a471a661e93 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:37:47 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] VM Stopped (Lifecycle Event)
Apr 13 20:37:47 user nova-compute[71285]: DEBUG nova.compute.manager [None req-97650648-ecae-4032-825b-a1619eda211a None None] [instance: b8bcf189-a781-474e-bc4f-8a471a661e93] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:37:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.compute.manager [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing instance network info cache due to event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:48 user nova-compute[71285]: INFO nova.compute.manager [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Detaching volume ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updated VIF entry in instance network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.network.neutron [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:48 user nova-compute[71285]: INFO nova.virt.block_device [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Attempting to driver detach volume ea7203e7-62fc-4103-9662-be40fbd06e1e from mountpoint /dev/vdb
Apr 13 20:37:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c5e8aeb9-63e4-4e9f-8277-6c67f5f6c81a req-fa1df1cd-6e65-4bec-bd95-552afb30fc2f service nova] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Attempting to detach device vdb from instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:37:48 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:37:48 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:37:48 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:37:48 user nova-compute[71285]:   <serial>ea7203e7-62fc-4103-9662-be40fbd06e1e</serial>
Apr 13 20:37:48 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:37:48 user nova-compute[71285]: </disk>
Apr 13 20:37:48 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:37:48 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully detached device vdb from instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 from the persistent domain config.
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:37:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:37:48 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:37:48 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:37:48 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:37:48 user nova-compute[71285]:   <serial>ea7203e7-62fc-4103-9662-be40fbd06e1e</serial>
Apr 13 20:37:48 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:37:48 user nova-compute[71285]: </disk>
Apr 13 20:37:48 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418269.3195136, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:37:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully detached device vdb from instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 from the live domain config.
Apr 13 20:37:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wZlPBEFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:37:49 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a321b7-053b-4f81-9780-b92aaf25b652]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:37:49 user nova-compute[71285]: No targets found.
Apr 13 20:37:49 user nova-compute[71285]: iSNS:
Apr 13 20:37:49 user nova-compute[71285]: No targets found.
Apr 13 20:37:49 user nova-compute[71285]: STATIC:
Apr 13 20:37:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e
Apr 13 20:37:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:37:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:37:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:49 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:37:49 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:37:49 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:37:49 user nova-compute[71285]: FIRMWARE:
Apr 13 20:37:49 user nova-compute[71285]: No targets found.
Apr 13 20:37:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:37:49 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:37:49 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd54af4b-a8c5-42a8-9bfe-79ce7482365f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e127f654-07b1-4a1c-8bf2-3dd2c23265f9]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:37:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:37:49 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:37:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc3863c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e'): ({'sde'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Removing single pathed devices sde {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de6bab-3396-4b46-826a-f1a6c1521117]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55862f87-0364-4fd0-8d3b-e12cf9f76fd3]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Flushing IO for device /dev/sde {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df36287-4dcc-44df-9be6-21c85397d5b0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e3b52-8f01-48de-8a1f-3d4be2bbdd7c]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77688cf6-abb9-4f4b-9455-df0ce3cbdf84]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1d11e6-f1b5-4e0a-9e32-250af7ae0451]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260]
Apr 13 20:37:49 user nova-compute[71285]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e, portal: 172.16.0.220,3260] successful.
Apr 13 20:37:49 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea7203e7-62fc-4103-9662-be40fbd06e1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4146ebe-c5fd-4a11-8508-8070eba190ad]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] <== disconnect_volume: return (309ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:37:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.objects.instance [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'flavor' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.compute.manager [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing instance network info cache due to event network-changed-09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Acquiring lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Acquired lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Refreshing network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-55e7f44c-fd43-42e5-838e-f9df7d97a524 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.705s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updated VIF entry in instance network info cache for port 09a5e612-1d46-4b74-bfaa-d5eb100ca621. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG nova.network.neutron [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [{"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c3c450b5-df4b-4f50-8cc0-e7cb803e817d req-c8158b7e-d0be-4091-ae22-ad78ea0d753d service nova] Releasing lock "refresh_cache-fd729f88-fb57-4e9b-9cb8-645dcd4ae441" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:52 user nova-compute[71285]: INFO nova.compute.manager [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Terminating instance
Apr 13 20:37:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-unplugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] No waiting events found dispatching network-vif-unplugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-52579d30-f826-4db8-ba2e-3a9ae30fe912 req-c04e4f43-953a-405f-b152-0c03044a47f6 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-unplugged-7f1026a7-0645-4eae-8338-5275284ecf2e for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:37:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Instance destroyed successfully.
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lazy-loading 'resources' on Instance uuid ea4eb9e9-983d-4009-8e32-56a4494961c5 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-323195761',display_name='tempest-VolumesActionsTest-instance-323195761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-323195761',id=33,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d550373054224fcbbb7300f512ad0345',ramdisk_id='',reservation_id='r-5st8ocgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1802743389',owner_user_name='tempest-VolumesActionsTest-1802743389-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:36:09Z,user_data=None,user_id='3993eb2be0d94cdbb16fd233999fc5c2',uuid=ea4eb9e9-983d-4009-8e32-56a4494961c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converting VIF {"id": "7f1026a7-0645-4eae-8338-5275284ecf2e", "address": "fa:16:3e:4c:50:07", "network": {"id": "72b4976e-72c4-4595-8a8c-89a79ac21d49", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1048697698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d550373054224fcbbb7300f512ad0345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f1026a7-06", "ovs_interfaceid": "7f1026a7-0645-4eae-8338-5275284ecf2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG os_vif [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f1026a7-06, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:37:53 user nova-compute[71285]: INFO os_vif [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:50:07,bridge_name='br-int',has_traffic_filtering=True,id=7f1026a7-0645-4eae-8338-5275284ecf2e,network=Network(72b4976e-72c4-4595-8a8c-89a79ac21d49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f1026a7-06')
Apr 13 20:37:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Deleting instance files /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5_del
Apr 13 20:37:53 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Deletion of /opt/stack/data/nova/instances/ea4eb9e9-983d-4009-8e32-56a4494961c5_del complete
Apr 13 20:37:53 user nova-compute[71285]: INFO nova.compute.manager [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:37:53 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Took 0.50 seconds to deallocate network for instance.
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:37:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:37:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:54 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Deleted allocations for instance ea4eb9e9-983d-4009-8e32-56a4494961c5
Apr 13 20:37:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-266e455d-7165-4797-9b41-1009631500b5 tempest-VolumesActionsTest-1802743389 tempest-VolumesActionsTest-1802743389-project-member] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.569s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Acquiring lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] Lock "ea4eb9e9-983d-4009-8e32-56a4494961c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] No waiting events found dispatching network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:37:55 user nova-compute[71285]: WARNING nova.compute.manager [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received unexpected event network-vif-plugged-7f1026a7-0645-4eae-8338-5275284ecf2e for instance with vm_state deleted and task_state None.
Apr 13 20:37:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-1331c606-10b0-483c-bb6d-4315ad8026b8 req-1285f5f9-cf6c-4ab7-a0a8-4d60e69661e5 service nova] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Received event network-vif-deleted-7f1026a7-0645-4eae-8338-5275284ecf2e {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:37:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:56 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:37:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:37:58 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:37:58 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8036MB free_disk=26.325885772705078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 858248d1-eefa-462f-a075-078257c736e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1280MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:37:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:37:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:37:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:37:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:37:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:37:59 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [{"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-65b84d48-a188-45d4-8720-4036faeaca58" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:38:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:01 user nova-compute[71285]: DEBUG nova.compute.manager [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing instance network info cache due to event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:38:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:01 user nova-compute[71285]: DEBUG nova.network.neutron [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:38:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:02 user nova-compute[71285]: DEBUG nova.network.neutron [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updated VIF entry in instance network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:38:02 user nova-compute[71285]: DEBUG nova.network.neutron [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-63ce4dcb-053f-4182-85ee-e9f9b2911867 req-d2591241-2a5e-46bb-9a84-488c531d4c55 service nova] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.compute.manager [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing instance network info cache due to event network-changed-8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Acquiring lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Acquired lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Refreshing network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:03 user nova-compute[71285]: INFO nova.compute.manager [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Detaching volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:38:03 user nova-compute[71285]: INFO nova.virt.block_device [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Attempting to driver detach volume 1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a from mountpoint /dev/vdb
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Attempting to detach device vdb from instance 858248d1-eefa-462f-a075-078257c736e9 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:38:03 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:38:03 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:38:03 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:38:03 user nova-compute[71285]:   <serial>1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a</serial>
Apr 13 20:38:03 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:38:03 user nova-compute[71285]: </disk>
Apr 13 20:38:03 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:38:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully detached device vdb from instance 858248d1-eefa-462f-a075-078257c736e9 from the persistent domain config.
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 858248d1-eefa-462f-a075-078257c736e9 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:38:03 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:38:03 user nova-compute[71285]:   <source dev="/dev/sdd"/>
Apr 13 20:38:03 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:38:03 user nova-compute[71285]:   <serial>1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a</serial>
Apr 13 20:38:03 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:38:03 user nova-compute[71285]: </disk>
Apr 13 20:38:03 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updated VIF entry in instance network info cache for port 8e8101de-d339-437b-b94c-e40a63e6e6aa. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.network.neutron [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [{"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1cb25f4d-4168-4a8f-8b2e-6c18abdbeefe req-a3db2cff-61ca-4fef-a220-57bd61ef61f2 service nova] Releasing lock "refresh_cache-858248d1-eefa-462f-a075-078257c736e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418283.7617538, 858248d1-eefa-462f-a075-078257c736e9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:38:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully detached device vdb from instance 858248d1-eefa-462f-a075-078257c736e9 from the live domain config.
Apr 13 20:38:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPwRLupN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:38:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b73c47f-3c06-4150-96fe-cad016dc57fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:38:03 user nova-compute[71285]: No targets found.
Apr 13 20:38:03 user nova-compute[71285]: iSNS:
Apr 13 20:38:03 user nova-compute[71285]: No targets found.
Apr 13 20:38:03 user nova-compute[71285]: STATIC:
Apr 13 20:38:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:38:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:38:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:38:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:38:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:38:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:38:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a
Apr 13 20:38:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:38:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:38:03 user nova-compute[71285]: FIRMWARE:
Apr 13 20:38:03 user nova-compute[71285]: No targets found.
Apr 13 20:38:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:38:03 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:38:03 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa22f12-fdce-4d0e-8a82-e3f48c3f4d6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd88f90-3997-412e-885a-0491be9d6412]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:38:03 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:38:03 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:38:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a (non-flash)
Apr 13 20:38:03 user nova-compute[71285]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:38:03 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:38:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6476d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[536263a9-f6bb-4cd3-8f87-2c175d30a246]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340b929-c021-438a-a4bf-aa5f22e23bc0]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8090c486-1062-4456-aaa6-80aaeb7b40ef]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b66ee5-8a46-4ad1-9906-f268abd7006a]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca8f8cd-cc70-4360-8351-f32afb0c7f5e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f73001-ae59-4937-a348-40adfa5b71b0]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260]
Apr 13 20:38:04 user nova-compute[71285]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a, portal: 172.16.0.220,3260] successful.
Apr 13 20:38:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dc4b69b-58bb-4311-bcc9-4c7b8b6da99a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe5bdf2-d257-47c0-880f-5fc91f405d02]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] <== disconnect_volume: return (291ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'flavor' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-eb029978-d75e-4fd6-917b-f56a24020966 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:08 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418273.2787776, ea4eb9e9-983d-4009-8e32-56a4494961c5 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:38:08 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] VM Stopped (Lifecycle Event)
Apr 13 20:38:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-21f9b325-5079-46e3-b9a9-f830146461a6 None None] [instance: ea4eb9e9-983d-4009-8e32-56a4494961c5] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:38:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:38:23 user nova-compute[71285]: INFO nova.compute.claims [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Claim successful on node user
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.327s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:38:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.policy [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:38:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Creating image(s)
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "/opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "/opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.160s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk 1073741824" returned: 0 in 0.050s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Cannot resize image /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'migration_context' on Instance uuid 632463fb-75e1-458a-b9f7-8a19fdf7409b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Ensure instance console log exists: /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Successfully created port: 1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Successfully updated port: 1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing instance network info cache due to event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Instance network_info: |[{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Start _get_guest_xml network_info=[{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:38:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:38:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2071843580',display_name='tempest-ServerActionsTestJSON-server-2071843580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2071843580',id=36,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-ij6ja4vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=632463fb-75e1-458a-b9f7-8a19fdf7409b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid 632463fb-75e1-458a-b9f7-8a19fdf7409b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:38:26 user nova-compute[71285]:   <uuid>632463fb-75e1-458a-b9f7-8a19fdf7409b</uuid>
Apr 13 20:38:26 user nova-compute[71285]:   <name>instance-00000024</name>
Apr 13 20:38:26 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:38:26 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:38:26 user nova-compute[71285]:   <metadata>
Apr 13 20:38:26 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:38:26 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-2071843580</nova:name>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:38:26</nova:creationTime>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:38:26 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:38:26 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:owner>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:38:26 user nova-compute[71285]:       </nova:owner>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:38:26 user nova-compute[71285]:       <nova:ports>
Apr 13 20:38:26 user nova-compute[71285]:         <nova:port uuid="1ca2b192-684d-4058-9a5a-8345a6e2cc3c">
Apr 13 20:38:26 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 20:38:26 user nova-compute[71285]:         </nova:port>
Apr 13 20:38:26 user nova-compute[71285]:       </nova:ports>
Apr 13 20:38:26 user nova-compute[71285]:     </nova:instance>
Apr 13 20:38:26 user nova-compute[71285]:   </metadata>
Apr 13 20:38:26 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:38:26 user nova-compute[71285]:     <system>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="serial">632463fb-75e1-458a-b9f7-8a19fdf7409b</entry>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="uuid">632463fb-75e1-458a-b9f7-8a19fdf7409b</entry>
Apr 13 20:38:26 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:38:26 user nova-compute[71285]:     </system>
Apr 13 20:38:26 user nova-compute[71285]:   </sysinfo>
Apr 13 20:38:26 user nova-compute[71285]:   <os>
Apr 13 20:38:26 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:38:26 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:38:26 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:38:26 user nova-compute[71285]:   </os>
Apr 13 20:38:26 user nova-compute[71285]:   <features>
Apr 13 20:38:26 user nova-compute[71285]:     <acpi/>
Apr 13 20:38:26 user nova-compute[71285]:     <apic/>
Apr 13 20:38:26 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:38:26 user nova-compute[71285]:   </features>
Apr 13 20:38:26 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:38:26 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:38:26 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:38:26 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:38:26 user nova-compute[71285]:   </clock>
Apr 13 20:38:26 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:38:26 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:38:26 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:38:26 user nova-compute[71285]:   </cpu>
Apr 13 20:38:26 user nova-compute[71285]:   <devices>
Apr 13 20:38:26 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:38:26 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:38:26 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk"/>
Apr 13 20:38:26 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:38:26 user nova-compute[71285]:     </disk>
Apr 13 20:38:26 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:38:26 user nova-compute[71285]:       <mac address="fa:16:3e:eb:f7:17"/>
Apr 13 20:38:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:38:26 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:38:26 user nova-compute[71285]:       <target dev="tap1ca2b192-68"/>
Apr 13 20:38:26 user nova-compute[71285]:     </interface>
Apr 13 20:38:26 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:38:26 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/console.log" append="off"/>
Apr 13 20:38:26 user nova-compute[71285]:     </serial>
Apr 13 20:38:26 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:38:26 user nova-compute[71285]:     <video>
Apr 13 20:38:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:38:26 user nova-compute[71285]:     </video>
Apr 13 20:38:26 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:38:26 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:38:26 user nova-compute[71285]:     </rng>
Apr 13 20:38:26 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:38:26 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:38:26 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:38:26 user nova-compute[71285]:     </memballoon>
Apr 13 20:38:26 user nova-compute[71285]:   </devices>
Apr 13 20:38:26 user nova-compute[71285]: </domain>
Apr 13 20:38:26 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2071843580',display_name='tempest-ServerActionsTestJSON-server-2071843580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2071843580',id=36,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-ij6ja4vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=632463fb-75e1-458a-b9f7-8a19fdf7409b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG os_vif [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ca2b192-68, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1ca2b192-68, col_values=(('external_ids', {'iface-id': '1ca2b192-684d-4058-9a5a-8345a6e2cc3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:f7:17', 'vm-uuid': '632463fb-75e1-458a-b9f7-8a19fdf7409b'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:26 user nova-compute[71285]: INFO os_vif [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68')
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:eb:f7:17, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updated VIF entry in instance network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6f9e9b39-c492-4b02-8ff9-063a44af53ea req-3f26af4f-a219-409d-973a-36d4c49ba7c9 service nova] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] No waiting events found dispatching network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:27 user nova-compute[71285]: WARNING nova.compute.manager [req-0c16f5c5-d97b-47bd-ba1b-eae14286805c req-1429f799-84e5-4528-8be4-fd1285ae7e5b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received unexpected event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance with vm_state building and task_state spawning.
Apr 13 20:38:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418309.6472828, 632463fb-75e1-458a-b9f7-8a19fdf7409b => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] VM Resumed (Lifecycle Event)
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Instance spawned successfully.
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418309.6507852, 632463fb-75e1-458a-b9f7-8a19fdf7409b => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] VM Started (Lifecycle Event)
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Took 5.50 seconds to spawn the instance on the hypervisor.
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] No waiting events found dispatching network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:29 user nova-compute[71285]: WARNING nova.compute.manager [req-e68557a9-3cd4-4662-b43f-e123d75149d3 req-54467640-12fe-46ea-8090-6d36ea73380b service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received unexpected event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance with vm_state building and task_state spawning.
Apr 13 20:38:29 user nova-compute[71285]: INFO nova.compute.manager [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Took 6.15 seconds to build instance.
Apr 13 20:38:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-71f57210-b30a-4cb0-be70-1057141d4408 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.249s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing instance network info cache due to event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:34 user nova-compute[71285]: INFO nova.compute.manager [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Shelve offloading
Apr 13 20:38:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updated VIF entry in instance network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.network.neutron [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b185d196-30f9-4e91-a136-336f9a0488f8 req-21c06d08-b80b-4e2b-815c-4623cdba33a7 service nova] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:34 user nova-compute[71285]: DEBUG nova.compute.manager [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:34 user nova-compute[71285]: WARNING nova.compute.manager [req-89a050d5-6c58-4742-92fb-5c2bfd1868b5 req-09e83419-e539-4e23-b219-470c41c04092 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state active and task_state shelving.
Apr 13 20:38:35 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance destroyed successfully.
Apr 13 20:38:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:35 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:38:35 user nova-compute[71285]: DEBUG nova.network.neutron [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance destroyed successfully.
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'resources' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnZUWq96lLQWm647DGAaRq6+rWKgdmIWyN/Z8MUSyiSM9qp5+NoLJa0pen2ZdlQna4LIuZyhqJfhQ+SDeG8Acqb8lYZOWAIaEsWHKVjuYIBLdCciq2oo0X92SlPcgzf2Q==',key_name='tempest-TestShelveInstance-455469676',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:36:52Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_vif [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaa20ef3-4f, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing instance network info cache due to event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:38:36 user nova-compute[71285]: INFO os_vif [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f')
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:38:36 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8675da8-d7b9-4382-b7b8-df303e853f8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:38:36 user nova-compute[71285]: No targets found.
Apr 13 20:38:36 user nova-compute[71285]: iSNS:
Apr 13 20:38:36 user nova-compute[71285]: No targets found.
Apr 13 20:38:36 user nova-compute[71285]: STATIC:
Apr 13 20:38:36 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:38:36 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:38:36 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:38:36 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:38:36 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:38:36 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:38:36 user nova-compute[71285]: FIRMWARE:
Apr 13 20:38:36 user nova-compute[71285]: No targets found.
Apr 13 20:38:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:38:36 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:38:36 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e6c4c7-dd49-4392-805e-0c839c9b937c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f74040-90a2-47c1-ac4f-8aaa291fc438]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:38:36 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:38:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:38:36 user nova-compute[71285]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:38:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc640dd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd1c69-b753-40c3-8a10-238af3bb591f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e990cb5-3837-4606-af92-e43344a737c7]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6eca7a-50a0-4a45-a521-5792e73c29e9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d103907-5022-4bd9-9832-6c587345cc4c]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c34684-3eab-4c30-bd2f-ea92b88e98c5]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf96574-16e5-48c5-8f55-1ac92b4fc3ac]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]
Apr 13 20:38:36 user nova-compute[71285]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.
Apr 13 20:38:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff4e89-5723-4e59-b4b6-c0dfd4c3687b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== disconnect_volume: return (335ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:38:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deleting instance files /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37_del
Apr 13 20:38:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deletion of /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37_del complete
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updated VIF entry in instance network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.network.neutron [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": null, "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cb73a8d9-17bf-4117-8a67-00e8598db71b req-6b1c5019-e0e4-4f62-89ff-315892f0d24b service nova] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:36 user nova-compute[71285]: WARNING nova.compute.manager [req-2cf398cd-cb32-4ffa-b9eb-f32e2c413f7b req-18b0d9be-b8d5-46a7-b820-6e5274ee29fb service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state active and task_state shelving.
Apr 13 20:38:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:38 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Deleted allocations for instance 4bb153e2-7b64-4495-8b9d-24be34497c37
Apr 13 20:38:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b63b33c0-a121-4bd2-96e9-3210382f33ae tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.006s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:39 user nova-compute[71285]: INFO nova.compute.manager [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Terminating instance
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.compute.manager [req-99047bda-21e6-4cc7-9c6d-f4c1f3e3a70f req-e710b0f5-45c4-4c74-8d96-3d7dab019c93 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-unplugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Instance destroyed successfully.
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid fd729f88-fb57-4e9b-9cb8-645dcd4ae441 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-675837111',display_name='tempest-ServerRescueNegativeTestJSON-server-675837111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-675837111',id=27,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB786rORhQxc4xur8ylm9URgCf1Ty59hjrLsa8BWuLoAgtAb3i83xpJ5ZXO+s/6wHVdt5Q/i+YiNlTUqN6RbDsKZfJ2v1Fjei+P1wDPDX400QY+aaJpsYbgDSONX/FKbA==',key_name='tempest-keypair-768981879',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-e530glrt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=fd729f88-fb57-4e9b-9cb8-645dcd4ae441,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "address": "fa:16:3e:15:19:ae", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a5e612-1d", "ovs_interfaceid": "09a5e612-1d46-4b74-bfaa-d5eb100ca621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG os_vif [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09a5e612-1d, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:38:39 user nova-compute[71285]: INFO os_vif [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:19:ae,bridge_name='br-int',has_traffic_filtering=True,id=09a5e612-1d46-4b74-bfaa-d5eb100ca621,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09a5e612-1d')
Apr 13 20:38:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Deleting instance files /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441_del
Apr 13 20:38:39 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Deletion of /opt/stack/data/nova/instances/fd729f88-fb57-4e9b-9cb8-645dcd4ae441_del complete
Apr 13 20:38:40 user nova-compute[71285]: INFO nova.compute.manager [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 13 20:38:40 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:40 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Took 0.67 seconds to deallocate network for instance.
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-deleted-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:40 user nova-compute[71285]: INFO nova.compute.manager [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Neutron deleted interface 09a5e612-1d46-4b74-bfaa-d5eb100ca621; detaching it from the instance and deleting it from the info cache
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.network.neutron [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-ddbf0dfc-2bc5-46fe-87fe-8cb3dcf6f954 req-ef58220c-af94-4c5c-9193-927c2456a81d service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Detach interface failed, port_id=09a5e612-1d46-4b74-bfaa-d5eb100ca621, reason: Instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:41 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Deleted allocations for instance fd729f88-fb57-4e9b-9cb8-645dcd4ae441
Apr 13 20:38:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d576dca-e9a5-4818-bbf1-d253bb35d208 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Acquiring lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] Lock "fd729f88-fb57-4e9b-9cb8-645dcd4ae441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:41 user nova-compute[71285]: DEBUG nova.compute.manager [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] No waiting events found dispatching network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:41 user nova-compute[71285]: WARNING nova.compute.manager [req-2790a5b0-8ce5-4b9d-83f2-ce9a8e1f139d req-0202d784-4e9c-4ef0-94d8-0b15a319aaa2 service nova] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Received unexpected event network-vif-plugged-09a5e612-1d46-4b74-bfaa-d5eb100ca621 for instance with vm_state deleted and task_state None.
Apr 13 20:38:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:50 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418315.149897, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:38:50 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Stopped (Lifecycle Event)
Apr 13 20:38:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b8e15985-048e-4027-ac08-c7e70f025fdf None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:53 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:54 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418319.9312098, fd729f88-fb57-4e9b-9cb8-645dcd4ae441 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:38:54 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] VM Stopped (Lifecycle Event)
Apr 13 20:38:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1fdd96a1-e776-48a1-b3ba-b1b9148e7b86 None None] [instance: fd729f88-fb57-4e9b-9cb8-645dcd4ae441] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:38:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:57 user nova-compute[71285]: INFO nova.compute.manager [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Terminating instance
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-2ff64c21-4f1c-4793-92d5-f25c336b91f0 req-68ce2eea-9a97-4c16-a56a-869d53bec96d service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-unplugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:38:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Instance destroyed successfully.
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lazy-loading 'resources' on Instance uuid 858248d1-eefa-462f-a075-078257c736e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886625623',display_name='tempest-TestMinimumBasicScenario-server-886625623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886625623',id=31,image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2S5vFB89cjhQNHK5tZERx5gotmSUz6nfYAxb1HGI7pIUEexdW1x3UmogJ+OT5avBe+NR2lh0fefQ4RhxvlylngtZR/3ODNtw6vOAC/JGaj6FVzVw6aEo4e8xfRqWS5uA==',key_name='tempest-TestMinimumBasicScenario-1669926210',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:34:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41f1e999778042e2a606a2ae4072bc83',ramdisk_id='',reservation_id='r-ne0tvu22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b68e778d-6c7f-4c39-a545-ef4067ed0d6d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1286218256',owner_user_name='tempest-TestMinimumBasicScenario-1286218256-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:36:19Z,user_data=None,user_id='519afe2b763347ea889f7de8773d7de0',uuid=858248d1-eefa-462f-a075-078257c736e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converting VIF {"id": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "address": "fa:16:3e:0b:28:2f", "network": {"id": "01cb6d35-c31b-48c0-8594-46a80ae181d6", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1385813589-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41f1e999778042e2a606a2ae4072bc83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e8101de-d3", "ovs_interfaceid": "8e8101de-d339-437b-b94c-e40a63e6e6aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG os_vif [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e8101de-d3, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:38:57 user nova-compute[71285]: INFO os_vif [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:28:2f,bridge_name='br-int',has_traffic_filtering=True,id=8e8101de-d339-437b-b94c-e40a63e6e6aa,network=Network(01cb6d35-c31b-48c0-8594-46a80ae181d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e8101de-d3')
Apr 13 20:38:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Deleting instance files /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9_del
Apr 13 20:38:57 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Deletion of /opt/stack/data/nova/instances/858248d1-eefa-462f-a075-078257c736e9_del complete
Apr 13 20:38:58 user nova-compute[71285]: INFO nova.compute.manager [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] [instance: 858248d1-eefa-462f-a075-078257c736e9] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:38:58 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-deleted-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:59 user nova-compute[71285]: INFO nova.compute.manager [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Neutron deleted interface 8e8101de-d339-437b-b94c-e40a63e6e6aa; detaching it from the instance and deleting it from the info cache
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.network.neutron [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:38:59 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] Took 1.09 seconds to deallocate network for instance.
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-ff1da0ca-5788-450c-9f64-e28d2b01ac0a req-92342d6d-db66-4ec9-b44c-3198432fd181 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Detach interface failed, port_id=8e8101de-d339-437b-b94c-e40a63e6e6aa, reason: Instance 858248d1-eefa-462f-a075-078257c736e9 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Acquiring lock "858248d1-eefa-462f-a075-078257c736e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] Lock "858248d1-eefa-462f-a075-078257c736e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] No waiting events found dispatching network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:38:59 user nova-compute[71285]: WARNING nova.compute.manager [req-fdb97405-eb98-4a9b-900c-082884e3725b req-98d14b71-6b51-4b90-a5f2-711faabfbf80 service nova] [instance: 858248d1-eefa-462f-a075-078257c736e9] Received unexpected event network-vif-plugged-8e8101de-d339-437b-b94c-e40a63e6e6aa for instance with vm_state deleted and task_state None.
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:38:59 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.058s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:39:01 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8211MB free_disk=25.87078094482422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:01 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Deleted allocations for instance 858248d1-eefa-462f-a075-078257c736e9
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 65b84d48-a188-45d4-8720-4036faeaca58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:39:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a70d7d0a-ce63-49d5-8967-cc9e5b112680 tempest-TestMinimumBasicScenario-1286218256 tempest-TestMinimumBasicScenario-1286218256-project-member] Lock "858248d1-eefa-462f-a075-078257c736e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.965s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.065s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:39:04 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:12 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418337.930856, 858248d1-eefa-462f-a075-078257c736e9 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:39:12 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 858248d1-eefa-462f-a075-078257c736e9] VM Stopped (Lifecycle Event)
Apr 13 20:39:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-10a1c8d6-3154-463a-9535-28ecf751dbc1 None None] [instance: 858248d1-eefa-462f-a075-078257c736e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:39:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-changed-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Refreshing instance network info cache due to event network-changed-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Acquiring lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Acquired lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Refreshing network info cache for port 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:23 user nova-compute[71285]: INFO nova.compute.manager [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Terminating instance
Apr 13 20:39:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-unplugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] No waiting events found dispatching network-vif-unplugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-0eee1862-b02b-44bb-af33-d8d764590c53 req-fc8cc1f0-7181-4a59-ab23-56d5dcb2256d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-unplugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.network.neutron [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updated VIF entry in instance network info cache for port 9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.network.neutron [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updating instance_info_cache with network_info: [{"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c9d6d437-3522-4dd8-8c0a-b91f03061985 req-48132b2b-6699-425e-bfa4-034e6ecacf2d service nova] Releasing lock "refresh_cache-6c4d5801-3b71-4ce3-83b9-9bf54507c444" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:39:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Instance destroyed successfully.
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid 6c4d5801-3b71-4ce3-83b9-9bf54507c444 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:37:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1706849453',display_name='tempest-TestVolumeBootPattern-server-1706849453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1706849453',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:37:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-mx8tvwtq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:37:42Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=6c4d5801-3b71-4ce3-83b9-9bf54507c444,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "address": "fa:16:3e:b1:0b:75", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9144b471-9a", "ovs_interfaceid": "9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_vif [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9144b471-9a, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:39:24 user nova-compute[71285]: INFO os_vif [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:0b:75,bridge_name='br-int',has_traffic_filtering=True,id=9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9144b471-9a')
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:39:24 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85aac592-81a8-484f-9f98-2cd3e4dec255]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:39:24 user nova-compute[71285]: No targets found.
Apr 13 20:39:24 user nova-compute[71285]: iSNS:
Apr 13 20:39:24 user nova-compute[71285]: No targets found.
Apr 13 20:39:24 user nova-compute[71285]: STATIC:
Apr 13 20:39:24 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:39:24 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:39:24 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:39:24 user nova-compute[71285]: FIRMWARE:
Apr 13 20:39:24 user nova-compute[71285]: No targets found.
Apr 13 20:39:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:39:24 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:39:24 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[001d4a0c-41e1-40f1-ada9-d5a1fb92207b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b009f66-70ae-4cc3-b41e-89b9a43b400a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:39:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:39:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c28ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2312d-942d-42ec-84dc-f3ef55f5e354]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe43e36-fb5c-4056-9e73-1e37c8c3ca2a]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc47489-f3eb-42c5-a507-2f7fc32c8ee4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a4bdf-3a1e-47a1-928a-3482f073c64b]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23565393834343862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_970ce235', '/dev/disk/by-id/scsi-1SCST_BIO970ce235-5e98448b6c1980c3') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd618721-4023-47a3-a26d-ad1c79ae6431]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[232f33f2-08b7-4f72-af3d-654ce342e671]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf83ef-e56e-4633-b2cd-e73e899d476b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]
Apr 13 20:39:24 user nova-compute[71285]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.
Apr 13 20:39:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555a7e3-187a-4c81-ad91-73ffa249d388]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (308ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:39:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Deleting instance files /opt/stack/data/nova/instances/6c4d5801-3b71-4ce3-83b9-9bf54507c444_del
Apr 13 20:39:24 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Deletion of /opt/stack/data/nova/instances/6c4d5801-3b71-4ce3-83b9-9bf54507c444_del complete
Apr 13 20:39:24 user nova-compute[71285]: INFO nova.compute.manager [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 13 20:39:24 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:39:24 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:39:25 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:39:25 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Took 0.76 seconds to deallocate network for instance.
Apr 13 20:39:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Acquiring lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] No waiting events found dispatching network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:26 user nova-compute[71285]: WARNING nova.compute.manager [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received unexpected event network-vif-plugged-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc for instance with vm_state active and task_state deleting.
Apr 13 20:39:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-2f46a278-718e-483f-8d80-fcbb6b88269c req-3e7bd1db-fb68-4ffd-b953-5946c8592def service nova] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Received event network-vif-deleted-9144b471-9a6a-4098-bbe7-8fd3b0c8b4cc {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:26 user nova-compute[71285]: INFO nova.compute.manager [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Took 0.80 seconds to detach 1 volumes for instance.
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:26 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance 6c4d5801-3b71-4ce3-83b9-9bf54507c444
Apr 13 20:39:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-b2e2f0f0-77ab-4c4b-b8f5-4b320d26077d tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "6c4d5801-3b71-4ce3-83b9-9bf54507c444" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.237s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:37 user nova-compute[71285]: INFO nova.compute.manager [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Terminating instance
Apr 13 20:39:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-d98701e6-1cf8-4ff7-b823-0272e76f1333 req-1ca3ea34-b0c9-46d7-9083-7beff1a4b0b8 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-unplugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:39:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Instance destroyed successfully.
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid 65b84d48-a188-45d4-8720-4036faeaca58 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1131214979',display_name='tempest-ServerRescueNegativeTestJSON-server-1131214979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1131214979',id=16,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:25:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-hffpcayr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:25:33Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=65b84d48-a188-45d4-8720-4036faeaca58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "address": "fa:16:3e:3d:86:d0", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4ebdd2-ce", "ovs_interfaceid": "ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG os_vif [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4ebdd2-ce, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:39:38 user nova-compute[71285]: INFO os_vif [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:86:d0,bridge_name='br-int',has_traffic_filtering=True,id=ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca4ebdd2-ce')
Apr 13 20:39:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Deleting instance files /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58_del
Apr 13 20:39:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Deletion of /opt/stack/data/nova/instances/65b84d48-a188-45d4-8720-4036faeaca58_del complete
Apr 13 20:39:38 user nova-compute[71285]: INFO nova.compute.manager [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Took 0.75 seconds to destroy the instance on the hypervisor.
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:39:38 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Took 0.43 seconds to deallocate network for instance.
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:39:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:39 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Deleted allocations for instance 65b84d48-a188-45d4-8720-4036faeaca58
Apr 13 20:39:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1386ba65-db82-4a47-b063-116d23a41741 tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "65b84d48-a188-45d4-8720-4036faeaca58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.543s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:39 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418364.471628, 6c4d5801-3b71-4ce3-83b9-9bf54507c444 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:39:39 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] VM Stopped (Lifecycle Event)
Apr 13 20:39:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5bf38c3b-fe0d-42d8-8333-2899338c68a9 None None] [instance: 6c4d5801-3b71-4ce3-83b9-9bf54507c444] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Acquiring lock "65b84d48-a188-45d4-8720-4036faeaca58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] Lock "65b84d48-a188-45d4-8720-4036faeaca58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] No waiting events found dispatching network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:40 user nova-compute[71285]: WARNING nova.compute.manager [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received unexpected event network-vif-plugged-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 for instance with vm_state deleted and task_state None.
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [req-32cdc6aa-0b5d-411d-8392-91920ded994f req-fc41a984-e9ca-48b3-b04a-9a65db872fe6 service nova] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Received event network-vif-deleted-ca4ebdd2-cec3-40da-92c6-b9dc7b4a5bb9 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:39:40 user nova-compute[71285]: INFO nova.compute.claims [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Claim successful on node user
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:39:40 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:39:40 user nova-compute[71285]: DEBUG nova.policy [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:39:41 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Creating image(s)
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "/opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "/opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "/opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk 1073741824" returned: 0 in 0.050s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Successfully created port: f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Cannot resize image /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.objects.instance [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'migration_context' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Ensure instance console log exists: /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:41 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Successfully updated port: f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquired lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-changed-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Refreshing instance network info cache due to event network-changed-f14dfe80-4160-4d1e-a21d-08d2c72ca784. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Acquiring lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:39:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Updating instance_info_cache with network_info: [{"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Releasing lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Instance network_info: |[{"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Acquired lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Refreshing network info cache for port f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Start _get_guest_xml network_info=[{"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:39:43 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:39:43 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2052775286',display_name='tempest-VolumesSnapshotTestJSON-instance-2052775286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2052775286',id=37,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-dygfvvj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:39:41Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=64e4caf7-fdb8-4766-a8cd-4953473c3933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'pci_devices' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:39:43 user nova-compute[71285]:   <uuid>64e4caf7-fdb8-4766-a8cd-4953473c3933</uuid>
Apr 13 20:39:43 user nova-compute[71285]:   <name>instance-00000025</name>
Apr 13 20:39:43 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:39:43 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:39:43 user nova-compute[71285]:   <metadata>
Apr 13 20:39:43 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:39:43 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2052775286</nova:name>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:39:43</nova:creationTime>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:39:43 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:39:43 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:owner>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:user uuid="24880a07e48f4125b4a63048c6f5237b">tempest-VolumesSnapshotTestJSON-2146034860-project-member</nova:user>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:project uuid="0a8f583cda274b8ba1e6383d1aa142d7">tempest-VolumesSnapshotTestJSON-2146034860</nova:project>
Apr 13 20:39:43 user nova-compute[71285]:       </nova:owner>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:39:43 user nova-compute[71285]:       <nova:ports>
Apr 13 20:39:43 user nova-compute[71285]:         <nova:port uuid="f14dfe80-4160-4d1e-a21d-08d2c72ca784">
Apr 13 20:39:43 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 13 20:39:43 user nova-compute[71285]:         </nova:port>
Apr 13 20:39:43 user nova-compute[71285]:       </nova:ports>
Apr 13 20:39:43 user nova-compute[71285]:     </nova:instance>
Apr 13 20:39:43 user nova-compute[71285]:   </metadata>
Apr 13 20:39:43 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:39:43 user nova-compute[71285]:     <system>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="serial">64e4caf7-fdb8-4766-a8cd-4953473c3933</entry>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="uuid">64e4caf7-fdb8-4766-a8cd-4953473c3933</entry>
Apr 13 20:39:43 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:39:43 user nova-compute[71285]:     </system>
Apr 13 20:39:43 user nova-compute[71285]:   </sysinfo>
Apr 13 20:39:43 user nova-compute[71285]:   <os>
Apr 13 20:39:43 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:39:43 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:39:43 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:39:43 user nova-compute[71285]:   </os>
Apr 13 20:39:43 user nova-compute[71285]:   <features>
Apr 13 20:39:43 user nova-compute[71285]:     <acpi/>
Apr 13 20:39:43 user nova-compute[71285]:     <apic/>
Apr 13 20:39:43 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:39:43 user nova-compute[71285]:   </features>
Apr 13 20:39:43 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:39:43 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:39:43 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:39:43 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:39:43 user nova-compute[71285]:   </clock>
Apr 13 20:39:43 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:39:43 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:39:43 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:39:43 user nova-compute[71285]:   </cpu>
Apr 13 20:39:43 user nova-compute[71285]:   <devices>
Apr 13 20:39:43 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:39:43 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:39:43 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk"/>
Apr 13 20:39:43 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:39:43 user nova-compute[71285]:     </disk>
Apr 13 20:39:43 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:39:43 user nova-compute[71285]:       <mac address="fa:16:3e:9e:09:2b"/>
Apr 13 20:39:43 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:39:43 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:39:43 user nova-compute[71285]:       <target dev="tapf14dfe80-41"/>
Apr 13 20:39:43 user nova-compute[71285]:     </interface>
Apr 13 20:39:43 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:39:43 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/console.log" append="off"/>
Apr 13 20:39:43 user nova-compute[71285]:     </serial>
Apr 13 20:39:43 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:39:43 user nova-compute[71285]:     <video>
Apr 13 20:39:43 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:39:43 user nova-compute[71285]:     </video>
Apr 13 20:39:43 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:39:43 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:39:43 user nova-compute[71285]:     </rng>
Apr 13 20:39:43 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:39:43 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:39:43 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:39:43 user nova-compute[71285]:     </memballoon>
Apr 13 20:39:43 user nova-compute[71285]:   </devices>
Apr 13 20:39:43 user nova-compute[71285]: </domain>
Apr 13 20:39:43 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2052775286',display_name='tempest-VolumesSnapshotTestJSON-instance-2052775286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2052775286',id=37,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-dygfvvj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:39:41Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=64e4caf7-fdb8-4766-a8cd-4953473c3933,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG os_vif [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf14dfe80-41, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf14dfe80-41, col_values=(('external_ids', {'iface-id': 'f14dfe80-4160-4d1e-a21d-08d2c72ca784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:09:2b', 'vm-uuid': '64e4caf7-fdb8-4766-a8cd-4953473c3933'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:43 user nova-compute[71285]: INFO os_vif [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41')
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No VIF found with MAC fa:16:3e:9e:09:2b, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Updated VIF entry in instance network info cache for port f14dfe80-4160-4d1e-a21d-08d2c72ca784. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG nova.network.neutron [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Updating instance_info_cache with network_info: [{"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:39:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ea4a78ab-a49c-4f32-99f8-ef92695c4d39 req-48b661f5-42e0-4145-ac6d-5c2799bfd09e service nova] Releasing lock "refresh_cache-64e4caf7-fdb8-4766-a8cd-4953473c3933" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] No waiting events found dispatching network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:44 user nova-compute[71285]: WARNING nova.compute.manager [req-c8eaa296-144b-423a-b20b-59b23cb4c48e req-62eb1201-f5aa-4035-b9e7-54e5d3cc9591 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received unexpected event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance with vm_state building and task_state spawning.
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] No waiting events found dispatching network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:39:46 user nova-compute[71285]: WARNING nova.compute.manager [req-856bec70-690d-4d56-a4ca-079164fa3998 req-79fd372a-2773-4e7e-809a-1026f30f787b service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received unexpected event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance with vm_state building and task_state spawning.
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418386.8387074, 64e4caf7-fdb8-4766-a8cd-4953473c3933 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] VM Resumed (Lifecycle Event)
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Instance spawned successfully.
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418386.8399427, 64e4caf7-fdb8-4766-a8cd-4953473c3933 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] VM Started (Lifecycle Event)
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:39:46 user nova-compute[71285]: INFO nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Took 5.70 seconds to spawn the instance on the hypervisor.
Apr 13 20:39:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:47 user nova-compute[71285]: INFO nova.compute.manager [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Took 6.65 seconds to build instance.
Apr 13 20:39:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58918491-40aa-4bb9-b483-8537ac348b84 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.752s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:53 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418378.1680658, 65b84d48-a188-45d4-8720-4036faeaca58 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:39:53 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] VM Stopped (Lifecycle Event)
Apr 13 20:39:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6d35c34d-27de-4b7c-9549-79c987520d44 None None] [instance: 65b84d48-a188-45d4-8720-4036faeaca58] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:39:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:39:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8393MB free_disk=26.36193084716797GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [{"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-00d20026-e9af-4587-8930-d3dcfdb1ea3e" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:40:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:04 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:40:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing instance network info cache due to event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:40:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updated VIF entry in instance network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.network.neutron [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-326a0182-c5f8-43e4-b6c6-913e2a8bd128 req-0d27d7df-20a6-44f8-a050-6c072ff01e44 service nova] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:40:15 user nova-compute[71285]: INFO nova.compute.claims [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Claim successful on node user
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:40:15 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:40:15 user nova-compute[71285]: INFO nova.virt.block_device [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Booting with volume 45e7808c-5141-44a8-bdae-b556a6b5578c at /dev/vda
Apr 13 20:40:15 user nova-compute[71285]: DEBUG nova.policy [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG os_brick.utils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93b6559-eefc-410e-8e6e-fa2ab2d4346b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[48818b58-2e74-43d8-b340-549e8469ee39]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc21ac-d557-4dc0-8598-ffa89fafca3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[49630609-7020-4c4d-b40c-1f4136e15dfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:16 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:40:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37594e14-a7ef-4eec-87d0-70476b77706c]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG os_brick.utils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating existing volume attachment record: 3320b8d0-6284-44f5-b19d-c9e4a9c26400 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Successfully created port: 9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Successfully updated port: 9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing instance network info cache due to event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Acquiring lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Instance network_info: |[{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Acquired lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:17 user nova-compute[71285]: DEBUG nova.network.neutron [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updated VIF entry in instance network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a35e44d5-9714-4199-af6d-d1f73fc11f5f req-1288a3ea-3453-4a6a-ac65-8c4f3e347cde service nova] Releasing lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:40:18 user nova-compute[71285]: INFO nova.compute.claims [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Claim successful on node user
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:40:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:40:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG nova.policy [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04d351d2822a460d93748b98161d730c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e9553d7d1f49f68d3b20cb647f2062', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:40:19 user nova-compute[71285]: INFO nova.virt.block_device [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Booting with volume 151cb5ac-eddd-4883-ba83-7fbee0f2d350 at /dev/vda
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.utils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d5eef-91a2-47e7-9e1a-2581597d8247]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a288c-3adc-4d73-addf-aad149f6fdcd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12858ca-359c-4309-a389-72e1f6596526]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[205bdf74-6594-4b2f-8f18-91e3d1c7415d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:19 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:40:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a565f-5346-4a75-bcf6-d9ff1a164ce5]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG os_brick.utils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating existing volume attachment record: f81d77ea-9a85-47ea-aef4-b95f41398561 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:40:19 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Successfully created port: 0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Successfully updated port: 0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-changed-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.compute.manager [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Refreshing instance network info cache due to event network-changed-0bead699-f8a2-4731-bd2f-145f524e77b6. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:40:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Creating image(s)
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Ensure instance console log exists: /opt/stack/data/nova/instances/f7253b3f-8d1c-4bf4-a591-5088074aafbe/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Start _get_guest_xml network_info=[{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7253b3f-8d1c-4bf4-a591-5088074aafbe', 'attached_at': '', 'detached_at': '', 'volume_id': '45e7808c-5141-44a8-bdae-b556a6b5578c', 'serial': '45e7808c-5141-44a8-bdae-b556a6b5578c'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '3320b8d0-6284-44f5-b19d-c9e4a9c26400', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:40:20 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:20 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:20 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:20 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:20 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d1b8e-be91-4daf-9696-7aa04b4d1a9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:40:20 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a11ca-6344-479d-9fcd-60c78fa59b0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c] added
Apr 13 20:40:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[27513eea-73ab-4b7a-a291-7d0af9dd1f50]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e618b770-b170-4821-bfbb-ac3899e90d06]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFHCWQaY {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFHCWQaY" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6650d10d-7828-4ab8-a485-d0a74150568e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFHCWQaY'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b947f3-a18a-4a88-9173-0e7963566178]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9f37ff-36d1-4b48-8961-f7904aeed1de]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:40:20 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:40:20 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:20 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:40:20 user nova-compute[71285]: 
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ff4201-a8c9-4141-9d8c-7f12ccff35f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]
Apr 13 20:40:20 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.
Apr 13 20:40:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[16777bea-6f90-4c88-a552-8a55c9d55400]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea6e7b-f67d-4697-ae9e-0755688a6d3a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:40:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance network_info: |[{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Refreshing network info cache for port 0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c88225-6ab9-4cd0-8adc-c7a53fe89333]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updated VIF entry in instance network info cache for port 0bead699-f8a2-4731-bd2f-145f524e77b6. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG nova.network.neutron [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7e14e72f-209b-4e05-abfb-725de5e38129 req-e27405c6-9cb4-44a8-a3b2-afc5982777cf service nova] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23565393834343862', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565393834343862', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1476334002',display_name='tempest-TestVolumeBootPattern-server-1476334002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1476334002',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-a0ci8imh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:40:16Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=f7253b3f-8d1c-4bf4-a591-5088074aafbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid f7253b3f-8d1c-4bf4-a591-5088074aafbe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:40:22 user nova-compute[71285]:   <uuid>f7253b3f-8d1c-4bf4-a591-5088074aafbe</uuid>
Apr 13 20:40:22 user nova-compute[71285]:   <name>instance-00000026</name>
Apr 13 20:40:22 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:40:22 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:40:22 user nova-compute[71285]:   <metadata>
Apr 13 20:40:22 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:40:22 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:40:22 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-server-1476334002</nova:name>
Apr 13 20:40:22 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:40:20</nova:creationTime>
Apr 13 20:40:22 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:40:22 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:40:22 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:40:22 user nova-compute[71285]:       <nova:owner>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:40:22 user nova-compute[71285]:       </nova:owner>
Apr 13 20:40:22 user nova-compute[71285]:       <nova:ports>
Apr 13 20:40:22 user nova-compute[71285]:         <nova:port uuid="9c4f6683-1965-4f34-9834-9872c4f4ff98">
Apr 13 20:40:22 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 13 20:40:22 user nova-compute[71285]:         </nova:port>
Apr 13 20:40:22 user nova-compute[71285]:       </nova:ports>
Apr 13 20:40:22 user nova-compute[71285]:     </nova:instance>
Apr 13 20:40:22 user nova-compute[71285]:   </metadata>
Apr 13 20:40:22 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:40:22 user nova-compute[71285]:     <system>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="serial">f7253b3f-8d1c-4bf4-a591-5088074aafbe</entry>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="uuid">f7253b3f-8d1c-4bf4-a591-5088074aafbe</entry>
Apr 13 20:40:22 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:40:22 user nova-compute[71285]:     </system>
Apr 13 20:40:22 user nova-compute[71285]:   </sysinfo>
Apr 13 20:40:22 user nova-compute[71285]:   <os>
Apr 13 20:40:22 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:40:22 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:40:22 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:40:22 user nova-compute[71285]:   </os>
Apr 13 20:40:22 user nova-compute[71285]:   <features>
Apr 13 20:40:22 user nova-compute[71285]:     <acpi/>
Apr 13 20:40:22 user nova-compute[71285]:     <apic/>
Apr 13 20:40:22 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:40:22 user nova-compute[71285]:   </features>
Apr 13 20:40:22 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:40:22 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:40:22 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:40:22 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:40:22 user nova-compute[71285]:   </clock>
Apr 13 20:40:22 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:40:22 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:40:22 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:40:22 user nova-compute[71285]:   </cpu>
Apr 13 20:40:22 user nova-compute[71285]:   <devices>
Apr 13 20:40:22 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:40:22 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:40:22 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:40:22 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:40:22 user nova-compute[71285]:       <serial>45e7808c-5141-44a8-bdae-b556a6b5578c</serial>
Apr 13 20:40:22 user nova-compute[71285]:     </disk>
Apr 13 20:40:22 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:40:22 user nova-compute[71285]:       <mac address="fa:16:3e:7b:49:5b"/>
Apr 13 20:40:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:22 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:40:22 user nova-compute[71285]:       <target dev="tap9c4f6683-19"/>
Apr 13 20:40:22 user nova-compute[71285]:     </interface>
Apr 13 20:40:22 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:40:22 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/f7253b3f-8d1c-4bf4-a591-5088074aafbe/console.log" append="off"/>
Apr 13 20:40:22 user nova-compute[71285]:     </serial>
Apr 13 20:40:22 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:40:22 user nova-compute[71285]:     <video>
Apr 13 20:40:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:22 user nova-compute[71285]:     </video>
Apr 13 20:40:22 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:40:22 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:40:22 user nova-compute[71285]:     </rng>
Apr 13 20:40:22 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:40:22 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:40:22 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:40:22 user nova-compute[71285]:     </memballoon>
Apr 13 20:40:22 user nova-compute[71285]:   </devices>
Apr 13 20:40:22 user nova-compute[71285]: </domain>
Apr 13 20:40:22 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1476334002',display_name='tempest-TestVolumeBootPattern-server-1476334002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1476334002',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-a0ci8imh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:40:16Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=f7253b3f-8d1c-4bf4-a591-5088074aafbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG os_vif [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c4f6683-19, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9c4f6683-19, col_values=(('external_ids', {'iface-id': '9c4f6683-1965-4f34-9834-9872c4f4ff98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:49:5b', 'vm-uuid': 'f7253b3f-8d1c-4bf4-a591-5088074aafbe'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:22 user nova-compute[71285]: INFO os_vif [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19')
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:7b:49:5b, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:40:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.compute.manager [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:23 user nova-compute[71285]: WARNING nova.compute.manager [req-a60f5eba-3a45-4520-86db-dd75005dd163 req-41784d34-31f4-4a3c-af51-2e0dcc4ab456 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state building and task_state spawning.
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:40:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Creating image(s)
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Ensure instance console log exists: /opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start _get_guest_xml network_info=[{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99cad31b-84d7-4b5b-b932-747848852c94', 'attached_at': '', 'detached_at': '', 'volume_id': '151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'serial': '151cb5ac-eddd-4883-ba83-7fbee0f2d350'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'f81d77ea-9a85-47ea-aef4-b95f41398561', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:40:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:23 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1996d169-4879-4eec-a604-523f2f7a91b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:40:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47848fb-10fa-49a9-a862-11464d2e6f6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350] added
Apr 13 20:40:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd268d0-bfa3-4ada-a805-2eb82bb50ef3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[592369a6-7f6d-4254-bbe8-4e27135a52dc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYTpfJul {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYTpfJul" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d518061-ea18-4964-8b85-9bf1f5f771ba]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYTpfJul'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5745dfe-4018-4460-8433-7d506f9f8629]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3150e-d5ed-429f-9341-661759a3dc1b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[04855a55-1c29-4701-9455-bb3a31be4da9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]
Apr 13 20:40:23 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.
Apr 13 20:40:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf848598-8865-4a6b-b026-2f8f73b6357c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc312a-f1fe-44c4-bfb0-29c910388117]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:24 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:24 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:24 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8c9e6c-7a7f-4b8a-889b-ed78e53ad321]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:40:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26231353833613033', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231353833613033', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:40:25 user nova-compute[71285]:   <uuid>99cad31b-84d7-4b5b-b932-747848852c94</uuid>
Apr 13 20:40:25 user nova-compute[71285]:   <name>instance-00000027</name>
Apr 13 20:40:25 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:40:25 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:40:25 user nova-compute[71285]:   <metadata>
Apr 13 20:40:25 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:40:25 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:40:25 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-689800020</nova:name>
Apr 13 20:40:25 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:40:23</nova:creationTime>
Apr 13 20:40:25 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:40:25 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:40:25 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:40:25 user nova-compute[71285]:       <nova:owner>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:40:25 user nova-compute[71285]:       </nova:owner>
Apr 13 20:40:25 user nova-compute[71285]:       <nova:ports>
Apr 13 20:40:25 user nova-compute[71285]:         <nova:port uuid="0bead699-f8a2-4731-bd2f-145f524e77b6">
Apr 13 20:40:25 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:40:25 user nova-compute[71285]:         </nova:port>
Apr 13 20:40:25 user nova-compute[71285]:       </nova:ports>
Apr 13 20:40:25 user nova-compute[71285]:     </nova:instance>
Apr 13 20:40:25 user nova-compute[71285]:   </metadata>
Apr 13 20:40:25 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:40:25 user nova-compute[71285]:     <system>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="serial">99cad31b-84d7-4b5b-b932-747848852c94</entry>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="uuid">99cad31b-84d7-4b5b-b932-747848852c94</entry>
Apr 13 20:40:25 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:40:25 user nova-compute[71285]:     </system>
Apr 13 20:40:25 user nova-compute[71285]:   </sysinfo>
Apr 13 20:40:25 user nova-compute[71285]:   <os>
Apr 13 20:40:25 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:40:25 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:40:25 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:40:25 user nova-compute[71285]:   </os>
Apr 13 20:40:25 user nova-compute[71285]:   <features>
Apr 13 20:40:25 user nova-compute[71285]:     <acpi/>
Apr 13 20:40:25 user nova-compute[71285]:     <apic/>
Apr 13 20:40:25 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:40:25 user nova-compute[71285]:   </features>
Apr 13 20:40:25 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:40:25 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:40:25 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:40:25 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:40:25 user nova-compute[71285]:   </clock>
Apr 13 20:40:25 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:40:25 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:40:25 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:40:25 user nova-compute[71285]:   </cpu>
Apr 13 20:40:25 user nova-compute[71285]:   <devices>
Apr 13 20:40:25 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:40:25 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:40:25 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:40:25 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:40:25 user nova-compute[71285]:       <serial>151cb5ac-eddd-4883-ba83-7fbee0f2d350</serial>
Apr 13 20:40:25 user nova-compute[71285]:     </disk>
Apr 13 20:40:25 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:40:25 user nova-compute[71285]:       <mac address="fa:16:3e:60:35:ef"/>
Apr 13 20:40:25 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:25 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:40:25 user nova-compute[71285]:       <target dev="tap0bead699-f8"/>
Apr 13 20:40:25 user nova-compute[71285]:     </interface>
Apr 13 20:40:25 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:40:25 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94/console.log" append="off"/>
Apr 13 20:40:25 user nova-compute[71285]:     </serial>
Apr 13 20:40:25 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:40:25 user nova-compute[71285]:     <video>
Apr 13 20:40:25 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:25 user nova-compute[71285]:     </video>
Apr 13 20:40:25 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:40:25 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:40:25 user nova-compute[71285]:     </rng>
Apr 13 20:40:25 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:40:25 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:40:25 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:40:25 user nova-compute[71285]:     </memballoon>
Apr 13 20:40:25 user nova-compute[71285]:   </devices>
Apr 13 20:40:25 user nova-compute[71285]: </domain>
Apr 13 20:40:25 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG os_vif [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bead699-f8, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bead699-f8, col_values=(('external_ids', {'iface-id': '0bead699-f8a2-4731-bd2f-145f524e77b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:35:ef', 'vm-uuid': '99cad31b-84d7-4b5b-b932-747848852c94'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:25 user nova-compute[71285]: INFO os_vif [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8')
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:60:35:ef, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418425.5225523, f7253b3f-8d1c-4bf4-a591-5088074aafbe => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] VM Resumed (Lifecycle Event)
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Instance spawned successfully.
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418425.5240996, f7253b3f-8d1c-4bf4-a591-5088074aafbe => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] VM Started (Lifecycle Event)
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Took 4.99 seconds to spawn the instance on the hypervisor.
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:25 user nova-compute[71285]: WARNING nova.compute.manager [req-6bacfd32-b479-499e-b92a-19cc9df1cf69 req-3016f21a-2a3e-4975-b56b-1deb8aa8bb71 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state building and task_state spawning.
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Took 10.34 seconds to build instance.
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d8d4ad7d-4953-4340-a46b-22fe0cc80979 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.431s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.compute.manager [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Unshelving
Apr 13 20:40:25 user nova-compute[71285]: INFO nova.virt.block_device [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Booting with volume 7127ca39-0a83-4dda-a67e-4630b25fd4a1 at /dev/vda
Apr 13 20:40:25 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9387a9b1-d050-45bd-99b3-b9f9b5e4ae43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eccea56-68db-4d59-8124-b26709988b94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef58df-0bae-4dff-bd3e-eec46192b043]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579ab45-3723-46a7-a005-ca542e9e0d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:40:26 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:40:26 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ecb4e3-266a-4c95-9f73-d71f8e29814f]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating existing volume attachment record: 8db6c977-7ada-463d-8e36-071fa718d63b {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:27 user nova-compute[71285]: WARNING nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state building and task_state spawning.
Apr 13 20:40:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:27 user nova-compute[71285]: WARNING nova.compute.manager [req-d6f9cb72-cd6c-40ee-accc-f7a28acdee7b req-5209394b-4276-43bf-be94-49414026bb37 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state building and task_state spawning.
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:28 user nova-compute[71285]: INFO nova.compute.manager [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Terminating instance
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418428.8945374, 99cad31b-84d7-4b5b-b932-747848852c94 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] VM Resumed (Lifecycle Event)
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:40:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance spawned successfully.
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-d46c3f95-7a8c-445a-a865-eb1985a3f7b0 req-b08481a2-4a7f-4430-981c-17998954ff56 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-unplugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418428.8961375, 99cad31b-84d7-4b5b-b932-747848852c94 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] VM Started (Lifecycle Event)
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Took 5.29 seconds to spawn the instance on the hypervisor.
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.compute.manager [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Took 10.61 seconds to build instance.
Apr 13 20:40:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4822b2be-dda0-4f50-9618-20254202ae3f tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.697s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Instance destroyed successfully.
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lazy-loading 'resources' on Instance uuid 00d20026-e9af-4587-8930-d3dcfdb1ea3e {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1930901382',display_name='tempest-ServerRescueNegativeTestJSON-server-1930901382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1930901382',id=15,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f747e06fa64492af3195a88e527bb3',ramdisk_id='',reservation_id='r-dkdzfdu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1471169552',owner_user_name='tempest-ServerRescueNegativeTestJSON-1471169552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:30:18Z,user_data=None,user_id='c89de9f7e5014fa8b0ff7b808bedfb91',uuid=00d20026-e9af-4587-8930-d3dcfdb1ea3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converting VIF {"id": "374f6442-f0a3-4801-a43f-4566b1aec40b", "address": "fa:16:3e:98:81:3c", "network": {"id": "fcb01a90-9ce8-48cc-af1d-862288650760", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1020551056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "89f747e06fa64492af3195a88e527bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap374f6442-f0", "ovs_interfaceid": "374f6442-f0a3-4801-a43f-4566b1aec40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG os_vif [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap374f6442-f0, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:40:29 user nova-compute[71285]: INFO os_vif [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:81:3c,bridge_name='br-int',has_traffic_filtering=True,id=374f6442-f0a3-4801-a43f-4566b1aec40b,network=Network(fcb01a90-9ce8-48cc-af1d-862288650760),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap374f6442-f0')
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Deleting instance files /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e_del
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Deletion of /opt/stack/data/nova/instances/00d20026-e9af-4587-8930-d3dcfdb1ea3e_del complete
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.compute.manager [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 20:40:29 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:29 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Took 0.47 seconds to deallocate network for instance.
Apr 13 20:40:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-94169a90-9d59-4259-85b9-9afec25418a3 req-ed25ff48-6252-4656-95bd-8269feb53e75 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-deleted-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:30 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Deleted allocations for instance 00d20026-e9af-4587-8930-d3dcfdb1ea3e
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-74d81106-e327-4090-9ca9-566389a7e21a tempest-ServerRescueNegativeTestJSON-1471169552 tempest-ServerRescueNegativeTestJSON-1471169552-project-member] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.870s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'pci_requests' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'numa_topology' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:30 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:40:30 user nova-compute[71285]: INFO nova.compute.claims [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Claim successful on node user
Apr 13 20:40:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Acquiring lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] Lock "00d20026-e9af-4587-8930-d3dcfdb1ea3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG nova.compute.manager [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] No waiting events found dispatching network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:31 user nova-compute[71285]: WARNING nova.compute.manager [req-9790f49f-2592-470f-808f-a1e87f889022 req-ccf6439b-8de3-48c6-b198-620f466b2ea5 service nova] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Received unexpected event network-vif-plugged-374f6442-f0a3-4801-a43f-4566b1aec40b for instance with vm_state deleted and task_state None.
Apr 13 20:40:31 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:40:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:31 user nova-compute[71285]: INFO nova.network.neutron [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG nova.compute.manager [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing instance network info cache due to event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:40:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:40:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Creating image(s)
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Ensure instance console log exists: /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start _get_guest_xml network_info=[{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4bb153e2-7b64-4495-8b9d-24be34497c37', 'attached_at': '', 'detached_at': '', 'volume_id': '7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'serial': '7127ca39-0a83-4dda-a67e-4630b25fd4a1'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '8db6c977-7ada-463d-8e36-071fa718d63b', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.network.neutron [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:40:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:40:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:40:33 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d33ec74-3c34-478e-9049-cd319185b22e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:40:33 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1687ada-418c-44bf-bc9c-4535576ca3aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1] added
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0094c06f-9073-4c59-9678-7e7ec0498c53]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa59d92-358b-4cb3-ae85-96c1a55f2ff6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pguOUwFJ {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pguOUwFJ" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f8c9c-0ce9-490c-a904-fab55a950ddc]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pguOUwFJ'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[75adbe38-f177-493b-9f79-4cb3301155da]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9defe25-670b-453c-b7d2-d68297d47c2b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f412bca7-13dd-4f74-82a2-d3e24276870d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]
Apr 13 20:40:33 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1a557e-9486-4559-b7aa-c7ca22283518]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[778ed24f-b28b-453c-9177-03e319e68617]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:40:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19268dbb-0312-41bd-bc5d-b1166ac05072]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.network.neutron [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updated VIF entry in instance network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG nova.network.neutron [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:40:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0120ea24-949e-45b4-8f5a-b9090f93c1bc req-085089a7-0aa1-4aa3-b6f6-356db0a4cc71 service nova] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23138636338633830', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138636338633830', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-455469676',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:40:26Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'pci_devices' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:40:34 user nova-compute[71285]:   <uuid>4bb153e2-7b64-4495-8b9d-24be34497c37</uuid>
Apr 13 20:40:34 user nova-compute[71285]:   <name>instance-00000022</name>
Apr 13 20:40:34 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:40:34 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:40:34 user nova-compute[71285]:   <metadata>
Apr 13 20:40:34 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:40:34 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:40:34 user nova-compute[71285]:       <nova:name>tempest-TestShelveInstance-server-2081085367</nova:name>
Apr 13 20:40:34 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:40:33</nova:creationTime>
Apr 13 20:40:34 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:40:34 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:40:34 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:40:34 user nova-compute[71285]:       <nova:owner>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:user uuid="99bfa0ed895e4574a3e0532e588ca74a">tempest-TestShelveInstance-1339516766-project-member</nova:user>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:project uuid="e0749bcd26454f179454d9f9cacbfbdb">tempest-TestShelveInstance-1339516766</nova:project>
Apr 13 20:40:34 user nova-compute[71285]:       </nova:owner>
Apr 13 20:40:34 user nova-compute[71285]:       <nova:ports>
Apr 13 20:40:34 user nova-compute[71285]:         <nova:port uuid="aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f">
Apr 13 20:40:34 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 13 20:40:34 user nova-compute[71285]:         </nova:port>
Apr 13 20:40:34 user nova-compute[71285]:       </nova:ports>
Apr 13 20:40:34 user nova-compute[71285]:     </nova:instance>
Apr 13 20:40:34 user nova-compute[71285]:   </metadata>
Apr 13 20:40:34 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:40:34 user nova-compute[71285]:     <system>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="serial">4bb153e2-7b64-4495-8b9d-24be34497c37</entry>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="uuid">4bb153e2-7b64-4495-8b9d-24be34497c37</entry>
Apr 13 20:40:34 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:40:34 user nova-compute[71285]:     </system>
Apr 13 20:40:34 user nova-compute[71285]:   </sysinfo>
Apr 13 20:40:34 user nova-compute[71285]:   <os>
Apr 13 20:40:34 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:40:34 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:40:34 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:40:34 user nova-compute[71285]:   </os>
Apr 13 20:40:34 user nova-compute[71285]:   <features>
Apr 13 20:40:34 user nova-compute[71285]:     <acpi/>
Apr 13 20:40:34 user nova-compute[71285]:     <apic/>
Apr 13 20:40:34 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:40:34 user nova-compute[71285]:   </features>
Apr 13 20:40:34 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:40:34 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:40:34 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:40:34 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:40:34 user nova-compute[71285]:   </clock>
Apr 13 20:40:34 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:40:34 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:40:34 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:40:34 user nova-compute[71285]:   </cpu>
Apr 13 20:40:34 user nova-compute[71285]:   <devices>
Apr 13 20:40:34 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:40:34 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:40:34 user nova-compute[71285]:       <source dev="/dev/sdd"/>
Apr 13 20:40:34 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:40:34 user nova-compute[71285]:       <serial>7127ca39-0a83-4dda-a67e-4630b25fd4a1</serial>
Apr 13 20:40:34 user nova-compute[71285]:     </disk>
Apr 13 20:40:34 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:40:34 user nova-compute[71285]:       <mac address="fa:16:3e:3e:6d:19"/>
Apr 13 20:40:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:34 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:40:34 user nova-compute[71285]:       <target dev="tapaaa20ef3-4f"/>
Apr 13 20:40:34 user nova-compute[71285]:     </interface>
Apr 13 20:40:34 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:40:34 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37/console.log" append="off"/>
Apr 13 20:40:34 user nova-compute[71285]:     </serial>
Apr 13 20:40:34 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:40:34 user nova-compute[71285]:     <video>
Apr 13 20:40:34 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:40:34 user nova-compute[71285]:     </video>
Apr 13 20:40:34 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:40:34 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:40:34 user nova-compute[71285]:     </rng>
Apr 13 20:40:34 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:40:34 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:40:34 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:40:34 user nova-compute[71285]:     </memballoon>
Apr 13 20:40:34 user nova-compute[71285]:   </devices>
Apr 13 20:40:34 user nova-compute[71285]: </domain>
Apr 13 20:40:34 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-455469676',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:36:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:40:26Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG os_vif [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaaa20ef3-4f, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaaa20ef3-4f, col_values=(('external_ids', {'iface-id': 'aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:6d:19', 'vm-uuid': '4bb153e2-7b64-4495-8b9d-24be34497c37'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:34 user nova-compute[71285]: INFO os_vif [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f')
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:40:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] No VIF found with MAC fa:16:3e:3e:6d:19, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:36 user nova-compute[71285]: WARNING nova.compute.manager [req-f3e019af-dda0-408e-8685-57a8f877eafe req-c58300f0-b2e7-45d0-bcd2-54b8c4a139b0 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418438.2410862, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Resumed (Lifecycle Event)
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:40:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance spawned successfully.
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:40:38 user nova-compute[71285]: WARNING nova.compute.manager [req-7a057ab3-4563-45d7-b5d7-e40baecda564 req-e869a4d3-1170-4b0b-97f2-a1203546f4d9 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state shelved_offloaded and task_state spawning.
Apr 13 20:40:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418438.24305, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Started (Lifecycle Event)
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:40:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:40:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1adeb7d-dc3b-45d0-b1b4-a49abc365edd tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.657s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:44 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418429.3286252, 00d20026-e9af-4587-8930-d3dcfdb1ea3e => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:40:44 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] VM Stopped (Lifecycle Event)
Apr 13 20:40:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e91bd7cb-b863-4d2d-8da5-78a5f79fc820 None None] [instance: 00d20026-e9af-4587-8930-d3dcfdb1ea3e] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:40:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:55 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:40:59 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:41:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:41:00 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8177MB free_disk=26.36966323852539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1152MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:41:00 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:41:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:41:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:41:01 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:41:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:41:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:41:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:41:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:05 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:41:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:41:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:41:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Ignoring supplied device name: /dev/vdb
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:30 user nova-compute[71285]: INFO nova.compute.manager [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Attaching volume e081e422-a9f1-4117-a274-b4517295659b to /dev/vdb
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.utils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e91f6b3-4251-4977-acda-0241889a3b6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83aa8043-921c-43fe-b965-6efd0e6cabb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b0cd9c-d407-4862-8ab3-5bf93b2cb1c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c5783a-b4ab-4e5c-805a-626a65166fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:41:30 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:41:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e853c96-7f93-4227-b617-d3d73da0c9ae]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG os_brick.utils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:41:30 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Updating existing volume attachment record: 92a2df29-7a87-48cd-989d-1dcac039f305 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:41:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilfjZOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:41:35 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:41:35 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:41:35 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e24aaa-0d8a-4201-9fe4-58e042fb3457]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:41:35 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9e21d-b8de-4e89-9d24-6e1ce5c207a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b] added
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b75d09-a14a-4300-9b5b-755556ac2143]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa615f9-5567-4c0d-8a43-667f84ad5bb7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilfjZOm {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wilfjZOm" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba0df0-12f8-4aeb-8944-656523b8dd45]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wilfjZOm'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a103455-ae2b-4dce-a351-38f46a7869c4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f3c1f-ea7e-4ba5-afe8-00d7a28b498c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8243f1b2-ad79-438b-869d-b3e081e61ec3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260]
Apr 13 20:41:35 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260] successful.
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46661d-7904-43be-a10a-f9bb6a99a5f3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ebd2b2-6c93-49bc-9af2-fcfd53372835]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:35 user nova-compute[71285]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)
Apr 13 20:41:35 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c4bc22-3e76-4d75-8cee-593f786817a3]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:41:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilfjZOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:41:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:41:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23866366235666261', 'path': '/dev/sde'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:41:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366235666261', 'path': '/dev/sde'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:41:36 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:41:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:41:36 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:41:36 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:41:36 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:41:36 user nova-compute[71285]:   <serial>e081e422-a9f1-4117-a274-b4517295659b</serial>
Apr 13 20:41:36 user nova-compute[71285]: </disk>
Apr 13 20:41:36 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:41:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:41:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:41:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No VIF found with MAC fa:16:3e:9e:09:2b, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:41:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d2fd7ae3-fb59-429f-b56d-b2fdf93365c4 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.873s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:41:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:51 user nova-compute[71285]: INFO nova.compute.manager [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Detaching volume e081e422-a9f1-4117-a274-b4517295659b
Apr 13 20:41:51 user nova-compute[71285]: INFO nova.virt.block_device [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Attempting to driver detach volume e081e422-a9f1-4117-a274-b4517295659b from mountpoint /dev/vdb
Apr 13 20:41:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Attempting to detach device vdb from instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:41:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:41:51 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:41:51 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:41:51 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:41:51 user nova-compute[71285]:   <serial>e081e422-a9f1-4117-a274-b4517295659b</serial>
Apr 13 20:41:51 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:41:51 user nova-compute[71285]: </disk>
Apr 13 20:41:51 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:41:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully detached device vdb from instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 from the persistent domain config.
Apr 13 20:41:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:41:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:41:51 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:41:51 user nova-compute[71285]:   <source dev="/dev/sde"/>
Apr 13 20:41:51 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:41:51 user nova-compute[71285]:   <serial>e081e422-a9f1-4117-a274-b4517295659b</serial>
Apr 13 20:41:51 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:41:51 user nova-compute[71285]: </disk>
Apr 13 20:41:51 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:41:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418512.1464145, 64e4caf7-fdb8-4766-a8cd-4953473c3933 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:41:52 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully detached device vdb from instance 64e4caf7-fdb8-4766-a8cd-4953473c3933 from the live domain config.
Apr 13 20:41:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilfjZOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:41:52 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87e767-4ac2-439d-88fb-040e9fe696d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:41:52 user nova-compute[71285]: No targets found.
Apr 13 20:41:52 user nova-compute[71285]: iSNS:
Apr 13 20:41:52 user nova-compute[71285]: No targets found.
Apr 13 20:41:52 user nova-compute[71285]: STATIC:
Apr 13 20:41:52 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:41:52 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:52 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:52 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:41:52 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:52 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:52 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b
Apr 13 20:41:52 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:52 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:52 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:41:52 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:52 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:52 user nova-compute[71285]: FIRMWARE:
Apr 13 20:41:52 user nova-compute[71285]: No targets found.
Apr 13 20:41:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:41:52 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:41:52 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f84f47-dac5-4485-b382-e915aacf58bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b4cfb4-f78c-4b57-bdbe-ab221020c015]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)
Apr 13 20:41:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:52 user nova-compute[71285]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b (non-flash)
Apr 13 20:41:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc642e55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b'): ({'sde'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Removing single pathed devices sde {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5cfdcd-9aeb-47d1-8e28-f48e7c1e7c59]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1afd41-9dd9-42e7-b3ba-d4d4c2e9cbba]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flushing IO for device /dev/sde {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9150fe3-00e1-4ef0-a12d-6069236c620f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9cf7bd-83f1-4fea-8330-0e3c03861e9a]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] SCSI volumes sde have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba9e6a2-1587-41c9-b024-bd694385e8b6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed31ba4-8588-40e6-9139-0bf6a889c244]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260]
Apr 13 20:41:52 user nova-compute[71285]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b, portal: 172.16.0.220,3260] successful.
Apr 13 20:41:52 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccc27d3-39dd-4a24-b08d-19984b2e6e07]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== disconnect_volume: return (337ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:41:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c7d080c2-8e29-4b17-a373-f4701951a39c tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.739s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.611s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:53 user nova-compute[71285]: INFO nova.compute.manager [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Terminating instance
Apr 13 20:41:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-unplugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] No waiting events found dispatching network-vif-unplugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-f289fa66-f640-4eeb-bec8-565d8cde5336 req-53dc18cc-ffa0-42ea-a58b-d598b2e1cfcf service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-unplugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Instance destroyed successfully.
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'resources' on Instance uuid 64e4caf7-fdb8-4766-a8cd-4953473c3933 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:39:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2052775286',display_name='tempest-VolumesSnapshotTestJSON-instance-2052775286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2052775286',id=37,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-dygfvvj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:39:47Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=64e4caf7-fdb8-4766-a8cd-4953473c3933,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "address": "fa:16:3e:9e:09:2b", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf14dfe80-41", "ovs_interfaceid": "f14dfe80-4160-4d1e-a21d-08d2c72ca784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_vif [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf14dfe80-41, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:41:54 user nova-compute[71285]: INFO os_vif [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:09:2b,bridge_name='br-int',has_traffic_filtering=True,id=f14dfe80-4160-4d1e-a21d-08d2c72ca784,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf14dfe80-41')
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wilfjZOm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:41:54 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2fdad4-aa21-42c3-89b3-e2e1882fd8f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:41:54 user nova-compute[71285]: No targets found.
Apr 13 20:41:54 user nova-compute[71285]: iSNS:
Apr 13 20:41:54 user nova-compute[71285]: No targets found.
Apr 13 20:41:54 user nova-compute[71285]: STATIC:
Apr 13 20:41:54 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:41:54 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:54 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:54 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:41:54 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:54 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:54 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:41:54 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:41:54 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:41:54 user nova-compute[71285]: FIRMWARE:
Apr 13 20:41:54 user nova-compute[71285]: No targets found.
Apr 13 20:41:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:41:54 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:41:54 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e081e422-a9f1-4117-a274-b4517295659b', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4f397-a817-40a6-9535-fbde43683a4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432253e-a378-400f-b1d6-8feed11a791e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:54 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:54 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:41:54 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:41:54 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:41:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a74ee0>, {}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Disconnecting from: [] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== disconnect_volume: return (91ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Deleting instance files /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933_del
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Deletion of /opt/stack/data/nova/instances/64e4caf7-fdb8-4766-a8cd-4953473c3933_del complete
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.compute.manager [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Took 0.50 seconds to deallocate network for instance.
Apr 13 20:41:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-ec82656d-8af5-4b09-a3c7-0847a3413ed6 req-c63b6530-4493-4a56-a5e3-46dfd65ee2ab service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-deleted-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:41:54 user nova-compute[71285]: WARNING nova.volume.cinder [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Attachment 92a2df29-7a87-48cd-989d-1dcac039f305 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 92a2df29-7a87-48cd-989d-1dcac039f305. (HTTP 404) (Request-ID: req-9e56188c-ec6d-43b4-aa52-38985cc64ddf)
Apr 13 20:41:54 user nova-compute[71285]: INFO nova.compute.manager [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Took 0.02 seconds to detach 1 volumes for instance.
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:55 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:41:55 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:41:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:55 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Deleted allocations for instance 64e4caf7-fdb8-4766-a8cd-4953473c3933
Apr 13 20:41:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4460adbe-8f6c-4839-90cc-ce463427a302 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.913s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:41:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Acquiring lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:41:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:41:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] Lock "64e4caf7-fdb8-4766-a8cd-4953473c3933-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:41:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] No waiting events found dispatching network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:41:56 user nova-compute[71285]: WARNING nova.compute.manager [req-9126a203-ed63-42da-9d92-e69de9bf3696 req-53d1ba39-67a0-41b1-b02a-d1d5aeb49845 service nova] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Received unexpected event network-vif-plugged-f14dfe80-4160-4d1e-a21d-08d2c72ca784 for instance with vm_state deleted and task_state None.
Apr 13 20:41:57 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:41:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:41:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:42:01 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:42:02 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:02 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8376MB free_disk=26.377010345458984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 4bb153e2-7b64-4495-8b9d-24be34497c37 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:42:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing instance network info cache due to event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Acquiring lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Acquired lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updated VIF entry in instance network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:08 user nova-compute[71285]: DEBUG nova.network.neutron [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a8cea454-0a5f-4972-bbb5-ee6a4ed089df req-7a812841-5708-46b7-a7b0-a82510388b21 service nova] Releasing lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:09 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418514.0821204, 64e4caf7-fdb8-4766-a8cd-4953473c3933 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:09 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] VM Stopped (Lifecycle Event)
Apr 13 20:42:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-b74c9d2f-ca60-4dee-90c8-01ec31fb9df6 None None] [instance: 64e4caf7-fdb8-4766-a8cd-4953473c3933] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:10 user nova-compute[71285]: DEBUG nova.compute.manager [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing instance network info cache due to event network-changed-1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:10 user nova-compute[71285]: DEBUG nova.network.neutron [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Refreshing network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updated VIF entry in instance network info cache for port 1ca2b192-684d-4058-9a5a-8345a6e2cc3c. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:11 user nova-compute[71285]: DEBUG nova.network.neutron [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b6612a53-ad2b-412c-98ee-9be24ce1af89 req-bd7096b3-fbde-4d0f-8a56-a838ad163522 service nova] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Stashing vm_state: active {{(pid=71285) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.objects.instance [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_requests' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:42:12 user nova-compute[71285]: INFO nova.compute.claims [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Claim successful on node user
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.objects.instance [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.objects.instance [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'pci_devices' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:12 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating resource usage from migration 4668f5ee-8ed6-4351-9b89-340a01baefbc
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:12 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.303s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:13 user nova-compute[71285]: INFO nova.compute.manager [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Migrating
Apr 13 20:42:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-changed-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Refreshing instance network info cache due to event network-changed-0bead699-f8a2-4731-bd2f-145f524e77b6. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Refreshing network info cache for port 0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Starting migrate_disk_and_power_off {{(pid=71285) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:42:14 user nova-compute[71285]: INFO nova.compute.claims [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Claim successful on node user
Apr 13 20:42:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updated VIF entry in instance network info cache for port 0bead699-f8a2-4731-bd2f-145f524e77b6. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:42:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0c100dc3-f2e0-4ad2-89c8-f1df48bc902b req-be0358cc-3c9c-4b39-a730-cf43ad21de04 service nova] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:42:15 user nova-compute[71285]: INFO nova.virt.block_device [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Booting with volume c4e5885c-fb8a-417c-81e1-6946fd13af51 at /dev/vda
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.policy [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e478a11b57b4ee385e33c4709adf04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65dc7126add94e0c97afbe225c8447a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:15 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance destroyed successfully.
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.utils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bead699-f8, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:15 user nova-compute[71285]: INFO os_vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8')
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:15 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c155a2a-35d5-4df0-b54c-66e928fd61f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:15 user nova-compute[71285]: WARNING nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state active and task_state resize_migrating.
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:15 user nova-compute[71285]: WARNING nova.compute.manager [req-2490e84e-f50e-49cc-b203-0b3e7354f982 req-6eacb31b-3480-4a77-aa7d-600ca82c7977 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state active and task_state resize_migrating.
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e7958-7d9f-47dc-a580-9abd2b904b4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:42:15 user nova-compute[71285]: No targets found.
Apr 13 20:42:15 user nova-compute[71285]: iSNS:
Apr 13 20:42:15 user nova-compute[71285]: No targets found.
Apr 13 20:42:15 user nova-compute[71285]: STATIC:
Apr 13 20:42:15 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:42:15 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:42:15 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:42:15 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:42:15 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:42:15 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:42:15 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:42:15 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:42:15 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:42:15 user nova-compute[71285]: FIRMWARE:
Apr 13 20:42:15 user nova-compute[71285]: No targets found.
Apr 13 20:42:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:42:15 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:42:15 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[256a1ad7-5e88-454a-8cf3-a61260a461ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802b016-dcc7-486f-ab48-4cc29ec30fac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a01345-2b77-4739-b14d-00ea3a5e1d4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[98caf80d-80bd-4f31-8184-5684881b95e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633c65b-f6b9-4dbd-b84c-d2c9e0d8bfd1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:15 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:42:15 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:42:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:15 user nova-compute[71285]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:42:15 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:42:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc645857e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:42:15 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6e1530-083d-4f8d-b161-13f9e6dcb9aa]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.utils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating existing volume attachment record: b112fbc3-8574-44b9-8db6-9df2821f0af5 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[493bae67-9abf-4b57-82d1-07be3a87662d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab5828f-6595-4270-bd97-804dea364e47]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f0aaf-b547-4ff6-b329-5c142c908403]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f5d18-d7ea-4d7c-bcb3-a5e30cffb385]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231353833613033', '/dev/disk/by-id/scsi-1SCST_BIOd7aebb7e-b1583a03ba6bc720', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d7aebb7e') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d34a5-8386-4f49-b599-8f8845cd7133]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8ee3b-c884-4196-a87a-9bcb73d35e80]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9514f4dc-b333-4c9a-8b75-2808f58f4f7c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]
Apr 13 20:42:15 user nova-compute[71285]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.
Apr 13 20:42:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77345057-57a7-4018-94f6-3580b9bf3474]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (381ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:42:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Successfully created port: 9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:16 user nova-compute[71285]: INFO nova.compute.manager [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Terminating instance
Apr 13 20:42:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Port 0bead699-f8a2-4731-bd2f-145f524e77b6 binding to destination host user is already ACTIVE {{(pid=71285) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-f016c7e8-1396-423e-b572-be0966b5c805 req-92b2815c-3eda-4ccc-a605-dcdf259d9f3b service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-unplugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing instance network info cache due to event network-changed-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Acquiring lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Acquired lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.neutron [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Refreshing network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Successfully updated port: 9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquired lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:42:17 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Instance destroyed successfully.
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lazy-loading 'resources' on Instance uuid 4bb153e2-7b64-4495-8b9d-24be34497c37 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-13T20:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081085367',display_name='tempest-TestShelveInstance-server-2081085367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081085367',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnZUWq96lLQWm647DGAaRq6+rWKgdmIWyN/Z8MUSyiSM9qp5+NoLJa0pen2ZdlQna4LIuZyhqJfhQ+SDeG8Acqb8lYZOWAIaEsWHKVjuYIBLdCciq2oo0X92SlPcgzf2Q==',key_name='tempest-TestShelveInstance-455469676',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:40:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0749bcd26454f179454d9f9cacbfbdb',ramdisk_id='',reservation_id='r-qlqe5uki',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1339516766',owner_user_name='tempest-TestShelveInstance-1339516766-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:40:38Z,user_data=None,user_id='99bfa0ed895e4574a3e0532e588ca74a',uuid=4bb153e2-7b64-4495-8b9d-24be34497c37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converting VIF {"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_vif [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaaa20ef3-4f, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:17 user nova-compute[71285]: INFO os_vif [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:6d:19,bridge_name='br-int',has_traffic_filtering=True,id=aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f,network=Network(49cd1e10-091e-47de-a17d-e26ea8103270),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaaa20ef3-4f')
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pguOUwFJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:17 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33bc313-dc8e-40d9-b03f-a07cecd5f243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:42:17 user nova-compute[71285]: No targets found.
Apr 13 20:42:17 user nova-compute[71285]: iSNS:
Apr 13 20:42:17 user nova-compute[71285]: No targets found.
Apr 13 20:42:17 user nova-compute[71285]: STATIC:
Apr 13 20:42:17 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:42:17 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:42:17 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:42:17 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1
Apr 13 20:42:17 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:42:17 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:42:17 user nova-compute[71285]: FIRMWARE:
Apr 13 20:42:17 user nova-compute[71285]: No targets found.
Apr 13 20:42:17 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:42:17 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:42:17 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b075b98f-3455-463a-8dd4-45663edf70ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0effa-e0ad-44e1-973d-f45d19405c7c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:17 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:42:17 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:17 user nova-compute[71285]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 (non-flash)
Apr 13 20:42:17 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a775b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f2a7f2-00c1-41c3-8204-f97fb6e3f73f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de7ffb-ccd1-414c-a6d7-9aafc6554437]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[332a513b-f2ae-4a73-9ce7-9954108734c8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating instance_info_cache with network_info: [{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Releasing lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Instance network_info: |[{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eff182e-c130-47be-943a-2d5adf8e8ed4]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.network.neutron [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e5928-1dcd-4d16-b3f1-bd5acd569bea]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebfd737-7cef-4ec2-8cd4-76052e2bbf2d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260]
Apr 13 20:42:18 user nova-compute[71285]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1, portal: 172.16.0.220,3260] successful.
Apr 13 20:42:18 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7127ca39-0a83-4dda-a67e-4630b25fd4a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.209s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3325521d-4b87-432f-a239-cd5162d4d6a9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.564s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] <== disconnect_volume: return (565ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:42:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deleting instance files /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37_del
Apr 13 20:42:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deletion of /opt/stack/data/nova/instances/4bb153e2-7b64-4495-8b9d-24be34497c37_del complete
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.utils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e198769-b10a-4ef9-a659-b133cfb5a0d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bcfc8-af51-4587-a2ef-b5bc240bc436]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: INFO nova.compute.manager [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Took 1.76 seconds to destroy the instance on the hypervisor.
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[42221352-d2c2-4418-9b85-1be4f902d484]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c4268b-0a67-42eb-93b5-d09f5b330176]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:42:18 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c2925-888b-4921-8938-14378e68c979]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG os_brick.utils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updated VIF entry in instance network info cache for port aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.network.neutron [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [{"id": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "address": "fa:16:3e:3e:6d:19", "network": {"id": "49cd1e10-091e-47de-a17d-e26ea8103270", "bridge": "br-int", "label": "tempest-TestShelveInstance-856101214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0749bcd26454f179454d9f9cacbfbdb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaaa20ef3-4f", "ovs_interfaceid": "aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4f1bc397-802f-4dbe-bfbb-840ad1c62810 req-f327e4dd-8f66-46b5-b7e1-9e5c9ec6d365 service nova] Releasing lock "refresh_cache-4bb153e2-7b64-4495-8b9d-24be34497c37" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:18 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Took 0.50 seconds to deallocate network for instance.
Apr 13 20:42:18 user nova-compute[71285]: DEBUG nova.compute.manager [req-ab2da4a4-eb83-4419-bf89-d4f94ef33bab req-042162e5-6de4-441f-aac3-bc4a1e30cd96 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-deleted-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing instance network info cache due to event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Acquiring lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Acquired lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updated VIF entry in instance network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.network.neutron [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating instance_info_cache with network_info: [{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Releasing lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Acquiring lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] No waiting events found dispatching network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:19 user nova-compute[71285]: WARNING nova.compute.manager [req-17b56dc5-c8dd-405b-94c6-b74640599c72 req-63e37bc6-902f-404d-a56d-ff0723e72e65 service nova] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Received unexpected event network-vif-plugged-aaa20ef3-4f45-4939-bf11-7a8bac3b5f7f for instance with vm_state active and task_state deleting.
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:42:19 user nova-compute[71285]: INFO nova.compute.manager [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Took 0.84 seconds to detach 1 volumes for instance.
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Deleting volume: 7127ca39-0a83-4dda-a67e-4630b25fd4a1 {{(pid=71285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:19 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:42:19 user nova-compute[71285]: INFO nova.compute.claims [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Claim successful on node user
Apr 13 20:42:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.270s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:42:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:42:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Creating image(s)
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Ensure instance console log exists: /opt/stack/data/nova/instances/e0c6ae32-1e90-4151-b5fe-465e3729a65c/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Start _get_guest_xml network_info=[{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITpbDgkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e0c6ae32-1e90-4151-b5fe-465e3729a65c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4e5885c-fb8a-417c-81e1-6946fd13af51', 'serial': 'c4e5885c-fb8a-417c-81e1-6946fd13af51'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'b112fbc3-8574-44b9-8db6-9df2821f0af5', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:42:20 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:20 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITpbDgkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:20 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:20 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:20 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.policy [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd37c755040ea402f96618b587efb5dca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078e29f3a0914d2492f7ff5ac6083859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f6809b-a6f8-4ca0-9591-de9d4454f467]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:42:20 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9190dbf-5e3e-4245-ab26-31945a6ab4e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51] added
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937e3ef-7c87-420e-98ed-11dbe79f5817]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:42:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Creating image(s)
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "/opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "/opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "/opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.105s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.123s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8780edd-b40c-4214-8551-a6c01b89df2e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITpbDgkY {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITpbDgkY" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563b46c-3f7b-4613-8df5-e2363fca7f67]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITpbDgkY'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0839c9b-38ac-4bd9-b1b5-b0de4e91fe5c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Deleted allocations for instance 4bb153e2-7b64-4495-8b9d-24be34497c37
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6ab728-8310-412c-9e7c-de59cb2ffcbc]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fbc97c-06f6-4160-850b-ca9eca1868ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260]
Apr 13 20:42:20 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260] successful.
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-3c70cab7-ce28-494a-9152-c90b7172371c tempest-TestShelveInstance-1339516766 tempest-TestShelveInstance-1339516766-project-member] Lock "4bb153e2-7b64-4495-8b9d-24be34497c37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.161s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f03e6-eedb-4a37-ba02-6f4130e4119d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[45400be8-6e0e-4569-ae36-11dbbe63487e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:20 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:20 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:20 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.484s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc620a3c-903f-4171-a2cc-b48529d97b99]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITpbDgkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk 1073741824" returned: 0 in 0.055s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Cannot resize image /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'migration_context' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Ensure instance console log exists: /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Successfully created port: 0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '23935626235663939', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935626235663939', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050216643',display_name='tempest-TestVolumeBootPattern-server-2050216643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050216643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-0ndvv0j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:15Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=e0c6ae32-1e90-4151-b5fe-465e3729a65c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'pci_devices' on Instance uuid e0c6ae32-1e90-4151-b5fe-465e3729a65c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:42:22 user nova-compute[71285]:   <uuid>e0c6ae32-1e90-4151-b5fe-465e3729a65c</uuid>
Apr 13 20:42:22 user nova-compute[71285]:   <name>instance-00000028</name>
Apr 13 20:42:22 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:42:22 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:42:22 user nova-compute[71285]:   <metadata>
Apr 13 20:42:22 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:42:22 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:name>tempest-TestVolumeBootPattern-server-2050216643</nova:name>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:42:20</nova:creationTime>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:42:22 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:owner>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:user uuid="7e478a11b57b4ee385e33c4709adf04b">tempest-TestVolumeBootPattern-2040418736-project-member</nova:user>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:project uuid="65dc7126add94e0c97afbe225c8447a4">tempest-TestVolumeBootPattern-2040418736</nova:project>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:owner>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:ports>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:port uuid="9f8191a8-df0e-4838-8422-5a5e85302e9b">
Apr 13 20:42:22 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 20:42:22 user nova-compute[71285]:         </nova:port>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:ports>
Apr 13 20:42:22 user nova-compute[71285]:     </nova:instance>
Apr 13 20:42:22 user nova-compute[71285]:   </metadata>
Apr 13 20:42:22 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:42:22 user nova-compute[71285]:     <system>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="serial">e0c6ae32-1e90-4151-b5fe-465e3729a65c</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="uuid">e0c6ae32-1e90-4151-b5fe-465e3729a65c</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:42:22 user nova-compute[71285]:     </system>
Apr 13 20:42:22 user nova-compute[71285]:   </sysinfo>
Apr 13 20:42:22 user nova-compute[71285]:   <os>
Apr 13 20:42:22 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:42:22 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:42:22 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:42:22 user nova-compute[71285]:   </os>
Apr 13 20:42:22 user nova-compute[71285]:   <features>
Apr 13 20:42:22 user nova-compute[71285]:     <acpi/>
Apr 13 20:42:22 user nova-compute[71285]:     <apic/>
Apr 13 20:42:22 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:42:22 user nova-compute[71285]:   </features>
Apr 13 20:42:22 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:42:22 user nova-compute[71285]:   </clock>
Apr 13 20:42:22 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:42:22 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:42:22 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:42:22 user nova-compute[71285]:   </cpu>
Apr 13 20:42:22 user nova-compute[71285]:   <devices>
Apr 13 20:42:22 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:42:22 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:42:22 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 20:42:22 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:       <serial>c4e5885c-fb8a-417c-81e1-6946fd13af51</serial>
Apr 13 20:42:22 user nova-compute[71285]:     </disk>
Apr 13 20:42:22 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:42:22 user nova-compute[71285]:       <mac address="fa:16:3e:44:fe:29"/>
Apr 13 20:42:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:42:22 user nova-compute[71285]:       <target dev="tap9f8191a8-df"/>
Apr 13 20:42:22 user nova-compute[71285]:     </interface>
Apr 13 20:42:22 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:42:22 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/e0c6ae32-1e90-4151-b5fe-465e3729a65c/console.log" append="off"/>
Apr 13 20:42:22 user nova-compute[71285]:     </serial>
Apr 13 20:42:22 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:42:22 user nova-compute[71285]:     <video>
Apr 13 20:42:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:     </video>
Apr 13 20:42:22 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:42:22 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:42:22 user nova-compute[71285]:     </rng>
Apr 13 20:42:22 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:42:22 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:42:22 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:42:22 user nova-compute[71285]:     </memballoon>
Apr 13 20:42:22 user nova-compute[71285]:   </devices>
Apr 13 20:42:22 user nova-compute[71285]: </domain>
Apr 13 20:42:22 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050216643',display_name='tempest-TestVolumeBootPattern-server-2050216643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050216643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-0ndvv0j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:15Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=e0c6ae32-1e90-4151-b5fe-465e3729a65c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG os_vif [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f8191a8-df, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f8191a8-df, col_values=(('external_ids', {'iface-id': '9f8191a8-df0e-4838-8422-5a5e85302e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:fe:29', 'vm-uuid': 'e0c6ae32-1e90-4151-b5fe-465e3729a65c'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: INFO os_vif [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df')
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] No VIF found with MAC fa:16:3e:44:fe:29, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Successfully updated port: 0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.compute.manager [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing instance network info cache due to event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Instance network_info: |[{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.neutron [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Start _get_guest_xml network_info=[{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:42:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:22 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1608632534',display_name='tempest-SnapshotDataIntegrityTests-server-1608632534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1608632534',id=41,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhOXBhf1EREMfWw7824K/m7ZWHva0Ib5kxoZBf1y/rD1+0w3EsV+DCuV1OLOfRq+SzB9mv575SLDbT1jgnsX+C2g9/ev6CIwZ+Gjd/H3yMnneQrMldzCHPrXL8Xq9ML6w==',key_name='tempest-SnapshotDataIntegrityTests-1395940804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='078e29f3a0914d2492f7ff5ac6083859',ramdisk_id='',reservation_id='r-bwgplzty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1436433817',owner_user_name='tempest-SnapshotDataIntegrityTests-1436433817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:20Z,user_data=None,user_id='d37c755040ea402f96618b587efb5dca',uuid=38831b52-4793-489b-87ea-3bbad883758c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converting VIF {"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.objects.instance [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'pci_devices' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:42:22 user nova-compute[71285]:   <uuid>38831b52-4793-489b-87ea-3bbad883758c</uuid>
Apr 13 20:42:22 user nova-compute[71285]:   <name>instance-00000029</name>
Apr 13 20:42:22 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:42:22 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:42:22 user nova-compute[71285]:   <metadata>
Apr 13 20:42:22 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:42:22 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1608632534</nova:name>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:42:22</nova:creationTime>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:42:22 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:owner>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:user uuid="d37c755040ea402f96618b587efb5dca">tempest-SnapshotDataIntegrityTests-1436433817-project-member</nova:user>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:project uuid="078e29f3a0914d2492f7ff5ac6083859">tempest-SnapshotDataIntegrityTests-1436433817</nova:project>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:owner>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:42:22 user nova-compute[71285]:       <nova:ports>
Apr 13 20:42:22 user nova-compute[71285]:         <nova:port uuid="0b225740-55dc-4bb0-be66-3c40b7a25e61">
Apr 13 20:42:22 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:42:22 user nova-compute[71285]:         </nova:port>
Apr 13 20:42:22 user nova-compute[71285]:       </nova:ports>
Apr 13 20:42:22 user nova-compute[71285]:     </nova:instance>
Apr 13 20:42:22 user nova-compute[71285]:   </metadata>
Apr 13 20:42:22 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:42:22 user nova-compute[71285]:     <system>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="serial">38831b52-4793-489b-87ea-3bbad883758c</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="uuid">38831b52-4793-489b-87ea-3bbad883758c</entry>
Apr 13 20:42:22 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:42:22 user nova-compute[71285]:     </system>
Apr 13 20:42:22 user nova-compute[71285]:   </sysinfo>
Apr 13 20:42:22 user nova-compute[71285]:   <os>
Apr 13 20:42:22 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:42:22 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:42:22 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:42:22 user nova-compute[71285]:   </os>
Apr 13 20:42:22 user nova-compute[71285]:   <features>
Apr 13 20:42:22 user nova-compute[71285]:     <acpi/>
Apr 13 20:42:22 user nova-compute[71285]:     <apic/>
Apr 13 20:42:22 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:42:22 user nova-compute[71285]:   </features>
Apr 13 20:42:22 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:42:22 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:42:22 user nova-compute[71285]:   </clock>
Apr 13 20:42:22 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:42:22 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:42:22 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:42:22 user nova-compute[71285]:   </cpu>
Apr 13 20:42:22 user nova-compute[71285]:   <devices>
Apr 13 20:42:22 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:42:22 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:42:22 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk"/>
Apr 13 20:42:22 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:     </disk>
Apr 13 20:42:22 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:42:22 user nova-compute[71285]:       <mac address="fa:16:3e:4e:4d:3f"/>
Apr 13 20:42:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:42:22 user nova-compute[71285]:       <target dev="tap0b225740-55"/>
Apr 13 20:42:22 user nova-compute[71285]:     </interface>
Apr 13 20:42:22 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:42:22 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/console.log" append="off"/>
Apr 13 20:42:22 user nova-compute[71285]:     </serial>
Apr 13 20:42:22 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:42:22 user nova-compute[71285]:     <video>
Apr 13 20:42:22 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:22 user nova-compute[71285]:     </video>
Apr 13 20:42:22 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:42:22 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:42:22 user nova-compute[71285]:     </rng>
Apr 13 20:42:22 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:42:22 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:42:22 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:42:22 user nova-compute[71285]:     </memballoon>
Apr 13 20:42:22 user nova-compute[71285]:   </devices>
Apr 13 20:42:22 user nova-compute[71285]: </domain>
Apr 13 20:42:22 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1608632534',display_name='tempest-SnapshotDataIntegrityTests-server-1608632534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1608632534',id=41,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhOXBhf1EREMfWw7824K/m7ZWHva0Ib5kxoZBf1y/rD1+0w3EsV+DCuV1OLOfRq+SzB9mv575SLDbT1jgnsX+C2g9/ev6CIwZ+Gjd/H3yMnneQrMldzCHPrXL8Xq9ML6w==',key_name='tempest-SnapshotDataIntegrityTests-1395940804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='078e29f3a0914d2492f7ff5ac6083859',ramdisk_id='',reservation_id='r-bwgplzty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1436433817',owner_user_name='tempest-SnapshotDataIntegrityTests-1436433817-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:20Z,user_data=None,user_id='d37c755040ea402f96618b587efb5dca',uuid=38831b52-4793-489b-87ea-3bbad883758c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converting VIF {"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG os_vif [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b225740-55, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b225740-55, col_values=(('external_ids', {'iface-id': '0b225740-55dc-4bb0-be66-3c40b7a25e61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:4d:3f', 'vm-uuid': '38831b52-4793-489b-87ea-3bbad883758c'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:22 user nova-compute[71285]: INFO os_vif [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55')
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:42:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No VIF found with MAC fa:16:3e:4e:4d:3f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updated VIF entry in instance network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.network.neutron [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e914a4ff-3ce0-4d87-acbd-5c3c6bd42163 req-8b6d14b6-31ff-4404-85ea-0c756f9b8020 service nova] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Starting finish_migration {{(pid=71285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:42:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Creating image(s)
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Ensure instance console log exists: /opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start _get_guest_xml network_info=[{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '99cad31b-84d7-4b5b-b932-747848852c94', 'attached_at': '2023-04-13T20:42:23.000000', 'detached_at': '', 'volume_id': '151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'serial': '151cb5ac-eddd-4883-ba83-7fbee0f2d350'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '4c51a16b-2c7c-45e6-9793-6ce9d7e1607d', 'delete_on_termination': True, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:42:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.objects.instance [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:42:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:23 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:42:23 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a72bdb-0bb4-4acb-be86-f167158330d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:42:23 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0400dadc-afc6-4bf3-b131-065cdbbe22e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350] added
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[389ddf6e-5450-4d2c-b2aa-f7b703419ef6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fda071a-9199-4ab9-841e-f03050ee8962]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYTpfJul {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LYTpfJul" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc4498e-bc9a-4544-8ccb-388978305d7f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LYTpfJul'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e95ef4a-e29f-442c-866b-3fdfec5cd990]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d37e434-eb4d-4cb8-8c58-48ae9f2a8562]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db91f1-eb39-47cc-b067-eaedd27bc1c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]
Apr 13 20:42:23 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[73973aa1-24db-4a84-8ca6-158295276e7c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[56684d25-d28f-4be8-9cfd-f1c0f5595c98]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:42:23 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[74404eb5-017a-43a6-933d-f7002ea10df5]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:42:23 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] No waiting events found dispatching network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:24 user nova-compute[71285]: WARNING nova.compute.manager [req-df01d7d0-d145-4f93-88c2-9e9926e2aac9 req-047d4a4b-2f21-4781-92f1-27856025c963 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received unexpected event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b for instance with vm_state building and task_state spawning.
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26231353833613033', 'path': '/dev/sdd'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231353833613033', 'path': '/dev/sdd'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:42:24 user nova-compute[71285]:   <uuid>99cad31b-84d7-4b5b-b932-747848852c94</uuid>
Apr 13 20:42:24 user nova-compute[71285]:   <name>instance-00000027</name>
Apr 13 20:42:24 user nova-compute[71285]:   <memory>196608</memory>
Apr 13 20:42:24 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:42:24 user nova-compute[71285]:   <metadata>
Apr 13 20:42:24 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:42:24 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:42:24 user nova-compute[71285]:       <nova:name>tempest-ServerActionsTestJSON-server-689800020</nova:name>
Apr 13 20:42:24 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:42:23</nova:creationTime>
Apr 13 20:42:24 user nova-compute[71285]:       <nova:flavor name="m1.micro">
Apr 13 20:42:24 user nova-compute[71285]:         <nova:memory>192</nova:memory>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:42:24 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:42:24 user nova-compute[71285]:       <nova:owner>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:user uuid="04d351d2822a460d93748b98161d730c">tempest-ServerActionsTestJSON-1522960802-project-member</nova:user>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:project uuid="c0e9553d7d1f49f68d3b20cb647f2062">tempest-ServerActionsTestJSON-1522960802</nova:project>
Apr 13 20:42:24 user nova-compute[71285]:       </nova:owner>
Apr 13 20:42:24 user nova-compute[71285]:       <nova:ports>
Apr 13 20:42:24 user nova-compute[71285]:         <nova:port uuid="0bead699-f8a2-4731-bd2f-145f524e77b6">
Apr 13 20:42:24 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 13 20:42:24 user nova-compute[71285]:         </nova:port>
Apr 13 20:42:24 user nova-compute[71285]:       </nova:ports>
Apr 13 20:42:24 user nova-compute[71285]:     </nova:instance>
Apr 13 20:42:24 user nova-compute[71285]:   </metadata>
Apr 13 20:42:24 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:42:24 user nova-compute[71285]:     <system>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="serial">99cad31b-84d7-4b5b-b932-747848852c94</entry>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="uuid">99cad31b-84d7-4b5b-b932-747848852c94</entry>
Apr 13 20:42:24 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:42:24 user nova-compute[71285]:     </system>
Apr 13 20:42:24 user nova-compute[71285]:   </sysinfo>
Apr 13 20:42:24 user nova-compute[71285]:   <os>
Apr 13 20:42:24 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:42:24 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:42:24 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:42:24 user nova-compute[71285]:   </os>
Apr 13 20:42:24 user nova-compute[71285]:   <features>
Apr 13 20:42:24 user nova-compute[71285]:     <acpi/>
Apr 13 20:42:24 user nova-compute[71285]:     <apic/>
Apr 13 20:42:24 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:42:24 user nova-compute[71285]:   </features>
Apr 13 20:42:24 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:42:24 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:42:24 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:42:24 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:42:24 user nova-compute[71285]:   </clock>
Apr 13 20:42:24 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:42:24 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:42:24 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:42:24 user nova-compute[71285]:   </cpu>
Apr 13 20:42:24 user nova-compute[71285]:   <devices>
Apr 13 20:42:24 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:42:24 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:42:24 user nova-compute[71285]:       <source dev="/dev/sdd"/>
Apr 13 20:42:24 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:42:24 user nova-compute[71285]:       <serial>151cb5ac-eddd-4883-ba83-7fbee0f2d350</serial>
Apr 13 20:42:24 user nova-compute[71285]:     </disk>
Apr 13 20:42:24 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:42:24 user nova-compute[71285]:       <mac address="fa:16:3e:60:35:ef"/>
Apr 13 20:42:24 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:24 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:42:24 user nova-compute[71285]:       <target dev="tap0bead699-f8"/>
Apr 13 20:42:24 user nova-compute[71285]:     </interface>
Apr 13 20:42:24 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:42:24 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94/console.log" append="off"/>
Apr 13 20:42:24 user nova-compute[71285]:     </serial>
Apr 13 20:42:24 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:42:24 user nova-compute[71285]:     <video>
Apr 13 20:42:24 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:24 user nova-compute[71285]:     </video>
Apr 13 20:42:24 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:42:24 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:42:24 user nova-compute[71285]:     </rng>
Apr 13 20:42:24 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:42:24 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:42:24 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:42:24 user nova-compute[71285]:     </memballoon>
Apr 13 20:42:24 user nova-compute[71285]:   </devices>
Apr 13 20:42:24 user nova-compute[71285]: </domain>
Apr 13 20:42:24 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1510203142-network", "vif_mac": "fa:16:3e:60:35:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG os_vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bead699-f8, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0bead699-f8, col_values=(('external_ids', {'iface-id': '0bead699-f8a2-4731-bd2f-145f524e77b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:35:ef', 'vm-uuid': '99cad31b-84d7-4b5b-b932-747848852c94'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:24 user nova-compute[71285]: INFO os_vif [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8')
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.compute.manager [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] No waiting events found dispatching network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:24 user nova-compute[71285]: WARNING nova.compute.manager [req-704ca4a4-e3a2-4aa5-b745-3ca17da6cd15 req-bb8725f6-971b-4a1d-b0aa-53a70e259bf8 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received unexpected event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance with vm_state building and task_state spawning.
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:42:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] No VIF found with MAC fa:16:3e:60:35:ef, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:42:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] No waiting events found dispatching network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:26 user nova-compute[71285]: WARNING nova.compute.manager [req-134a9848-97a9-4573-b875-b8ab207d755e req-93193ca5-b0ba-4533-a978-ff24e2cca72b service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received unexpected event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b for instance with vm_state building and task_state spawning.
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] No waiting events found dispatching network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:26 user nova-compute[71285]: WARNING nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received unexpected event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance with vm_state building and task_state spawning.
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:26 user nova-compute[71285]: WARNING nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state active and task_state resize_finish.
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:26 user nova-compute[71285]: WARNING nova.compute.manager [req-af677650-0e1e-4992-83b7-e234ff91bafe req-7e56dc29-541e-4de2-adda-29f1e9982840 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state active and task_state resize_finish.
Apr 13 20:42:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.1688461, 38831b52-4793-489b-87ea-3bbad883758c => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] VM Resumed (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Instance spawned successfully.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Instance spawned successfully.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.1701255, e0c6ae32-1e90-4151-b5fe-465e3729a65c => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] VM Resumed (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.1702168, 38831b52-4793-489b-87ea-3bbad883758c => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] VM Started (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Took 7.97 seconds to spawn the instance on the hypervisor.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Took 7.81 seconds to spawn the instance on the hypervisor.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.1715915, e0c6ae32-1e90-4151-b5fe-465e3729a65c => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] VM Started (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Took 8.65 seconds to build instance.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-396f92fd-4880-4375-b838-59b75149c7e8 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.753s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Took 13.92 seconds to build instance.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-31e160b5-5add-49e5-9d45-74254569e048 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.018s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 99cad31b-84d7-4b5b-b932-747848852c94 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.580142, 99cad31b-84d7-4b5b-b932-747848852c94 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] VM Resumed (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance running successfully.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Failed to set time: agent not configured {{(pid=71285) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-78680ea7-de9c-496a-9547-78ccf8452bc0 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] finish_migration finished successfully. {{(pid=71285) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418548.583642, 99cad31b-84d7-4b5b-b932-747848852c94 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] VM Started (Lifecycle Event)
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:28 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 13 20:42:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:32 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418537.6037292, 4bb153e2-7b64-4495-8b9d-24be34497c37 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:32 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] VM Stopped (Lifecycle Event)
Apr 13 20:42:32 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4e7f210d-edc7-4aa6-be7d-ba491e958401 None None] [instance: 4bb153e2-7b64-4495-8b9d-24be34497c37] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:42:52 user nova-compute[71285]: INFO nova.compute.claims [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Claim successful on node user
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:42:52 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.policy [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24880a07e48f4125b4a63048c6f5237b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a8f583cda274b8ba1e6383d1aa142d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:42:52 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Creating image(s)
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "/opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "/opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "/opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.114s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk 1073741824" returned: 0 in 0.058s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.164s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Successfully created port: b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Cannot resize image /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'migration_context' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Ensure instance console log exists: /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Successfully updated port: b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquired lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-changed-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Refreshing instance network info cache due to event network-changed-b9b33cac-436e-4b27-a1ec-1ca5838c9c21. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Acquiring lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Updating instance_info_cache with network_info: [{"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Releasing lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Instance network_info: |[{"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Acquired lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Refreshing network info cache for port b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Start _get_guest_xml network_info=[{"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:42:54 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:54 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-530196953',display_name='tempest-VolumesSnapshotTestJSON-instance-530196953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-530196953',id=42,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-lj0lf10o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:53Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=0865046e-7479-409c-9105-f202b4629851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'pci_devices' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:42:54 user nova-compute[71285]:   <uuid>0865046e-7479-409c-9105-f202b4629851</uuid>
Apr 13 20:42:54 user nova-compute[71285]:   <name>instance-0000002a</name>
Apr 13 20:42:54 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:42:54 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:42:54 user nova-compute[71285]:   <metadata>
Apr 13 20:42:54 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:42:54 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-530196953</nova:name>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:42:54</nova:creationTime>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:42:54 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:42:54 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:owner>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:user uuid="24880a07e48f4125b4a63048c6f5237b">tempest-VolumesSnapshotTestJSON-2146034860-project-member</nova:user>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:project uuid="0a8f583cda274b8ba1e6383d1aa142d7">tempest-VolumesSnapshotTestJSON-2146034860</nova:project>
Apr 13 20:42:54 user nova-compute[71285]:       </nova:owner>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:42:54 user nova-compute[71285]:       <nova:ports>
Apr 13 20:42:54 user nova-compute[71285]:         <nova:port uuid="b9b33cac-436e-4b27-a1ec-1ca5838c9c21">
Apr 13 20:42:54 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 13 20:42:54 user nova-compute[71285]:         </nova:port>
Apr 13 20:42:54 user nova-compute[71285]:       </nova:ports>
Apr 13 20:42:54 user nova-compute[71285]:     </nova:instance>
Apr 13 20:42:54 user nova-compute[71285]:   </metadata>
Apr 13 20:42:54 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:42:54 user nova-compute[71285]:     <system>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="serial">0865046e-7479-409c-9105-f202b4629851</entry>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="uuid">0865046e-7479-409c-9105-f202b4629851</entry>
Apr 13 20:42:54 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:42:54 user nova-compute[71285]:     </system>
Apr 13 20:42:54 user nova-compute[71285]:   </sysinfo>
Apr 13 20:42:54 user nova-compute[71285]:   <os>
Apr 13 20:42:54 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:42:54 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:42:54 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:42:54 user nova-compute[71285]:   </os>
Apr 13 20:42:54 user nova-compute[71285]:   <features>
Apr 13 20:42:54 user nova-compute[71285]:     <acpi/>
Apr 13 20:42:54 user nova-compute[71285]:     <apic/>
Apr 13 20:42:54 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:42:54 user nova-compute[71285]:   </features>
Apr 13 20:42:54 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:42:54 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:42:54 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:42:54 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:42:54 user nova-compute[71285]:   </clock>
Apr 13 20:42:54 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:42:54 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:42:54 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:42:54 user nova-compute[71285]:   </cpu>
Apr 13 20:42:54 user nova-compute[71285]:   <devices>
Apr 13 20:42:54 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:42:54 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:42:54 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk"/>
Apr 13 20:42:54 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:42:54 user nova-compute[71285]:     </disk>
Apr 13 20:42:54 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:42:54 user nova-compute[71285]:       <mac address="fa:16:3e:f0:2a:ea"/>
Apr 13 20:42:54 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:54 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:42:54 user nova-compute[71285]:       <target dev="tapb9b33cac-43"/>
Apr 13 20:42:54 user nova-compute[71285]:     </interface>
Apr 13 20:42:54 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:42:54 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/console.log" append="off"/>
Apr 13 20:42:54 user nova-compute[71285]:     </serial>
Apr 13 20:42:54 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:42:54 user nova-compute[71285]:     <video>
Apr 13 20:42:54 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:42:54 user nova-compute[71285]:     </video>
Apr 13 20:42:54 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:42:54 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:42:54 user nova-compute[71285]:     </rng>
Apr 13 20:42:54 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:42:54 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:42:54 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:42:54 user nova-compute[71285]:     </memballoon>
Apr 13 20:42:54 user nova-compute[71285]:   </devices>
Apr 13 20:42:54 user nova-compute[71285]: </domain>
Apr 13 20:42:54 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-530196953',display_name='tempest-VolumesSnapshotTestJSON-instance-530196953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-530196953',id=42,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-lj0lf10o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:42:53Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=0865046e-7479-409c-9105-f202b4629851,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG os_vif [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9b33cac-43, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb9b33cac-43, col_values=(('external_ids', {'iface-id': 'b9b33cac-436e-4b27-a1ec-1ca5838c9c21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:2a:ea', 'vm-uuid': '0865046e-7479-409c-9105-f202b4629851'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:54 user nova-compute[71285]: INFO os_vif [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43')
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:42:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No VIF found with MAC fa:16:3e:f0:2a:ea, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:42:55 user nova-compute[71285]: DEBUG nova.network.neutron [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Updated VIF entry in instance network info cache for port b9b33cac-436e-4b27-a1ec-1ca5838c9c21. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:42:55 user nova-compute[71285]: DEBUG nova.network.neutron [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Updating instance_info_cache with network_info: [{"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:42:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06697edf-400a-4746-a000-eeb4c9c6a039 req-bbb201dd-0a43-4487-a628-f62f7c51c7e8 service nova] Releasing lock "refresh_cache-0865046e-7479-409c-9105-f202b4629851" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Acquiring lock "0865046e-7479-409c-9105-f202b4629851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] No waiting events found dispatching network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:56 user nova-compute[71285]: WARNING nova.compute.manager [req-43a57f68-ec7d-496b-bbc7-91f89f1cdf80 req-19cea7b5-264f-4e26-8c36-740073d469a5 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received unexpected event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance with vm_state building and task_state spawning.
Apr 13 20:42:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418578.2552853, 0865046e-7479-409c-9105-f202b4629851 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] VM Resumed (Lifecycle Event)
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0865046e-7479-409c-9105-f202b4629851] Instance spawned successfully.
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418578.256362, 0865046e-7479-409c-9105-f202b4629851 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] VM Started (Lifecycle Event)
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Acquiring lock "0865046e-7479-409c-9105-f202b4629851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:58 user nova-compute[71285]: DEBUG nova.compute.manager [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] No waiting events found dispatching network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:42:58 user nova-compute[71285]: WARNING nova.compute.manager [req-95275eaa-4b72-4d34-9066-205185586c68 req-b53b1178-8045-41aa-9481-f9171e3ff89b service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received unexpected event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance with vm_state building and task_state spawning.
Apr 13 20:42:58 user nova-compute[71285]: INFO nova.compute.manager [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Took 6.08 seconds to build instance.
Apr 13 20:42:58 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e4a8acc5-47cf-4cc1-b189-20095e8e9134 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.176s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:42:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 632463fb-75e1-458a-b9f7-8a19fdf7409b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [{"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-632463fb-75e1-458a-b9f7-8a19fdf7409b" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:43:02 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:43:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:43:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:43:04 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=26.350547790527344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Applying migration context for instance 99cad31b-84d7-4b5b-b932-747848852c94 as it has an incoming, in-progress migration 4668f5ee-8ed6-4351-9b89-340a01baefbc. Migration status is finished {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 13 20:43:04 user nova-compute[71285]: INFO nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating resource usage from migration 4668f5ee-8ed6-4351-9b89-340a01baefbc
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Migration 4668f5ee-8ed6-4351-9b89-340a01baefbc is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0865046e-7479-409c-9105-f202b4629851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:43:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:43:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:43:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:43:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Going to confirm migration 2 {{(pid=71285) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'info_cache' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG nova.network.neutron [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG nova.objects.instance [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'migration_context' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.348s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:03 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Deleted allocation for migration 4668f5ee-8ed6-4351-9b89-340a01baefbc
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-194d9722-14fb-4d9d-b753-a5812b85abb1 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.368s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:03 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:04 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:05 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:44:05 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=26.322467803955078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance e0c6ae32-1e90-4151-b5fe-465e3729a65c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 0865046e-7479-409c-9105-f202b4629851 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:44:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing instance network info cache due to event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Acquiring lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Acquired lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updated VIF entry in instance network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating instance_info_cache with network_info: [{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8ad7e496-6de0-4c42-812f-9d5929068807 req-2627b505-abd3-4a82-96bc-88484bf591a0 service nova] Releasing lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing instance network info cache due to event network-changed-9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Acquiring lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Acquired lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.network.neutron [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Refreshing network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:06 user nova-compute[71285]: INFO nova.compute.manager [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Terminating instance
Apr 13 20:44:06 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:44:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-unplugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] No waiting events found dispatching network-vif-unplugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.compute.manager [req-fc8d0cda-22ea-4103-9edd-a44f7fa07721 req-644fa54f-3578-4e32-9dc7-656a6c6f1ce0 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-unplugged-9f8191a8-df0e-4838-8422-5a5e85302e9b for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updated VIF entry in instance network info cache for port 9f8191a8-df0e-4838-8422-5a5e85302e9b. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.network.neutron [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating instance_info_cache with network_info: [{"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-780dcafe-2a95-4d33-8929-b0f1ba3524eb req-034dce88-488b-4c72-8981-e44e3e9d902c service nova] Releasing lock "refresh_cache-e0c6ae32-1e90-4151-b5fe-465e3729a65c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Instance destroyed successfully.
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid e0c6ae32-1e90-4151-b5fe-465e3729a65c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2050216643',display_name='tempest-TestVolumeBootPattern-server-2050216643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2050216643',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:42:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-0ndvv0j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:28Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=e0c6ae32-1e90-4151-b5fe-465e3729a65c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "address": "fa:16:3e:44:fe:29", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8191a8-df", "ovs_interfaceid": "9f8191a8-df0e-4838-8422-5a5e85302e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_vif [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f8191a8-df, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:44:07 user nova-compute[71285]: INFO os_vif [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:fe:29,bridge_name='br-int',has_traffic_filtering=True,id=9f8191a8-df0e-4838-8422-5a5e85302e9b,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8191a8-df')
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITpbDgkY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:07 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9f2e6-8bf3-4e16-81ba-b0f8a3adbb9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:44:07 user nova-compute[71285]: No targets found.
Apr 13 20:44:07 user nova-compute[71285]: iSNS:
Apr 13 20:44:07 user nova-compute[71285]: No targets found.
Apr 13 20:44:07 user nova-compute[71285]: STATIC:
Apr 13 20:44:07 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:44:07 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:07 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:07 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51
Apr 13 20:44:07 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:07 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:07 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:44:07 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:07 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:07 user nova-compute[71285]: FIRMWARE:
Apr 13 20:44:07 user nova-compute[71285]: No targets found.
Apr 13 20:44:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:44:07 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:44:07 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d47728-c446-4ce6-8799-fe828bfdc588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[316baa1c-5772-4ffa-b44e-e000cd41a466]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:07 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:44:07 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:07 user nova-compute[71285]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 (non-flash)
Apr 13 20:44:07 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc387f0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b8c756-8ba3-456e-ad69-4ebbbf0d7282]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c5e0ea-ffe4-4f63-8738-315ef13cb53b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad00a82-a967-47d2-a4ed-fa3ba4b937a3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f73a0-d10c-4112-bf8d-6b65b5a387f6]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23935626235663939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_770f81db', '/dev/disk/by-id/scsi-1SCST_BIO770f81db-95bb5f99b9a99a6d') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b698bc-5083-430e-960d-3889f99caeea]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[382d1647-9db8-4507-a21d-623b5e5cc03f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[52762040-7127-4c6e-806a-36fdbddd2224]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260]
Apr 13 20:44:07 user nova-compute[71285]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51, portal: 172.16.0.220,3260] successful.
Apr 13 20:44:07 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e5885c-fb8a-417c-81e1-6946fd13af51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87beb3-d0f3-48e6-a891-c5ce9870b865]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (291ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:44:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Deleting instance files /opt/stack/data/nova/instances/e0c6ae32-1e90-4151-b5fe-465e3729a65c_del
Apr 13 20:44:07 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Deletion of /opt/stack/data/nova/instances/e0c6ae32-1e90-4151-b5fe-465e3729a65c_del complete
Apr 13 20:44:07 user nova-compute[71285]: INFO nova.compute.manager [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 13 20:44:07 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:44:07 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:44:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:08 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:08 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Took 0.51 seconds to deallocate network for instance.
Apr 13 20:44:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-b485da21-d0a8-4c0c-9178-47a6b63df7a4 req-44f4b381-282e-46f9-a3ce-ae5a5abe537d service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-deleted-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Acquiring lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG nova.compute.manager [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] No waiting events found dispatching network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:44:09 user nova-compute[71285]: WARNING nova.compute.manager [req-b7654254-3288-4490-b3c3-8536afb2f900 req-5e58879c-bcc8-43e4-8d90-f11420f81653 service nova] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Received unexpected event network-vif-plugged-9f8191a8-df0e-4838-8422-5a5e85302e9b for instance with vm_state active and task_state deleting.
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:09 user nova-compute[71285]: INFO nova.compute.manager [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Took 1.00 seconds to detach 1 volumes for instance.
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:09 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance e0c6ae32-1e90-4151-b5fe-465e3729a65c
Apr 13 20:44:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4247a0ca-81ab-4476-972e-ef427759eaab tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "e0c6ae32-1e90-4151-b5fe-465e3729a65c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:44:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:44:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.compute.manager [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing instance network info cache due to event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:14 user nova-compute[71285]: INFO nova.compute.manager [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attaching volume 9fe3f511-9880-41a0-8b5d-54aa190c2772 to /dev/vdb
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34a8eff-dc83-46df-b96d-bb57a20e3d34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updated VIF entry in instance network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.network.neutron [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4275257b-a2c8-4b4b-a995-c5498e92abf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-7fa9a8ad-fe55-47df-83df-2ad79f35b33e req-cc060e10-f87a-49bc-ab26-e29eb6818e36 service nova] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7395b-bf06-49d2-a395-b0bbca3a4193]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80acf4-8a29-431c-9927-084e01492e16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:44:14 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:44:14 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[83807075-8d16-4f9a-8e4b-11db4700e144]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG os_brick.utils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:14 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating existing volume attachment record: f6cc0829-add1-4983-8e3f-fa9fb789f143 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:44:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQyzmXIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:18 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:18 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:18 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:44:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478f109-9b26-4863-bd87-97edf86a4eb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:44:18 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[834bf6b8-e696-449f-ba99-436a628025d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772] added
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eaa3e2-8c1b-46b1-ad5b-f485593242ba]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac548c9d-f392-4715-8aa7-0399c22c43e3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQyzmXIS {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wQyzmXIS" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fc245a-6bbb-40aa-a93f-f4ea6aa3f925]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wQyzmXIS'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8905fc25-b251-4d72-9f8a-80081272676e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ed357-6956-4c22-ab51-d3a134c473b9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6361192-25fd-4b02-8b3d-b2c702fd951a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260]
Apr 13 20:44:19 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260] successful.
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9de5fd-3bc1-452f-abce-3e3ca265f1d1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0992123-0265-4587-b4b0-191dc09e27e0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)
Apr 13 20:44:19 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7025a363-9fe8-4404-b401-235e793aa73d]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:19 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQyzmXIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26137623036626461', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137623036626461', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:44:20 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:44:20 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:44:20 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:44:20 user nova-compute[71285]:   <serial>9fe3f511-9880-41a0-8b5d-54aa190c2772</serial>
Apr 13 20:44:20 user nova-compute[71285]: </disk>
Apr 13 20:44:20 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No VIF found with MAC fa:16:3e:4e:4d:3f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:44:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c1171ba3-db79-49eb-8c04-59f3b0122c19 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.362s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:22 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418647.5761528, e0c6ae32-1e90-4151-b5fe-465e3729a65c => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:44:22 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] VM Stopped (Lifecycle Event)
Apr 13 20:44:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a7d4ef2a-3866-4bf6-9480-9246c5cdfb7a None None] [instance: e0c6ae32-1e90-4151-b5fe-465e3729a65c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:44:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:29 user nova-compute[71285]: INFO nova.compute.manager [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Detaching volume 9fe3f511-9880-41a0-8b5d-54aa190c2772
Apr 13 20:44:30 user nova-compute[71285]: INFO nova.virt.block_device [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attempting to driver detach volume 9fe3f511-9880-41a0-8b5d-54aa190c2772 from mountpoint /dev/vdb
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Attempting to detach device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:44:30 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:44:30 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:44:30 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:44:30 user nova-compute[71285]:   <serial>9fe3f511-9880-41a0-8b5d-54aa190c2772</serial>
Apr 13 20:44:30 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:44:30 user nova-compute[71285]: </disk>
Apr 13 20:44:30 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:44:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config.
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:44:30 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:44:30 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:44:30 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:44:30 user nova-compute[71285]:   <serial>9fe3f511-9880-41a0-8b5d-54aa190c2772</serial>
Apr 13 20:44:30 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:44:30 user nova-compute[71285]: </disk>
Apr 13 20:44:30 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418670.4636638, 38831b52-4793-489b-87ea-3bbad883758c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:44:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config.
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wQyzmXIS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[698b728f-2fbf-4648-b1a3-0dbf1f1833d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:44:30 user nova-compute[71285]: No targets found.
Apr 13 20:44:30 user nova-compute[71285]: iSNS:
Apr 13 20:44:30 user nova-compute[71285]: No targets found.
Apr 13 20:44:30 user nova-compute[71285]: STATIC:
Apr 13 20:44:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:44:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:44:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:30 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772
Apr 13 20:44:30 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:44:30 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:44:30 user nova-compute[71285]: FIRMWARE:
Apr 13 20:44:30 user nova-compute[71285]: No targets found.
Apr 13 20:44:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:44:30 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:44:30 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcacf8b-0b91-4446-8bb0-3ac6ad33b08b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fd29ea-e4d0-470d-afca-2ec2fc67159b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:30 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:30 user nova-compute[71285]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)
Apr 13 20:44:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:30 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:30 user nova-compute[71285]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 (non-flash)
Apr 13 20:44:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc642e7f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4488b5-41fe-4972-923d-e275ce98075e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d2986-6454-4a02-a391-b1e5d64cc07b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2561972-5f2d-4162-a6b0-5001ad9debb4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e04fd-e6ac-4578-8c14-4ff37e664f1e]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2876fd3-36d2-495d-ba54-9c5f706bd5db]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa85c75-0ec8-4882-988e-d97db43d9108]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260]
Apr 13 20:44:30 user nova-compute[71285]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772, portal: 172.16.0.220,3260] successful.
Apr 13 20:44:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fe3f511-9880-41a0-8b5d-54aa190c2772 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[41610b29-c48d-4332-bd2c-9ddff5657ff2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== disconnect_volume: return (331ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:44:31 user nova-compute[71285]: DEBUG nova.objects.instance [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b72db0b-faa6-4672-a9de-1bd7e1479175 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.864s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:42 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Ignoring supplied device name: /dev/vdb
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:44:42 user nova-compute[71285]: INFO nova.compute.manager [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Attaching volume 25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 to /dev/vdb
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.utils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ad055-1b0e-4123-95e8-bba25597d420]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73046b7-a1a2-4d70-9802-227104cd43b6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b098ad7-e593-4da6-84a1-98d2c71c221a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13da4128-f2a0-4d91-8646-90d99f0eff4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:44:42 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:44:42 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bfb4cf-8276-46fd-beb3-a6372aca7e34]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG os_brick.utils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:42 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Updating existing volume attachment record: 38f25e6a-15e5-4ed8-845c-75ff65810492 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZUgwGTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:44:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:47 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:44:47 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcdce18-4dc1-4272-956e-38f0c5f9e6a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:44:47 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[93473443-6a5e-4e76-9e07-b5f09af22b83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24] added
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[048ff1e6-8b94-48df-9af7-eb27c4df6d55]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1190d9-4819-40e9-8bff-5004bf0c438d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZUgwGTW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EZUgwGTW" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf9a9e0-fc0e-49de-ad36-fb8f1468531a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EZUgwGTW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac9cd1-e638-4d18-8b27-62493f7b4864]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b3eadb-9df7-4337-ba04-d8333462ea99]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d31003-73dd-4ba4-bb58-325b9697b1b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260]
Apr 13 20:44:47 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260] successful.
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b6d12-d114-48f3-929c-7bd841924be0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[285c704a-2f34-4db6-b9ea-f9a7a6b0803a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)
Apr 13 20:44:47 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d098bdc2-8eb3-416b-a04f-cc0d1ebceed1]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:44:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZUgwGTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23562633037623535', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562633037623535', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:44:48 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:44:48 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:44:48 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:44:48 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:44:48 user nova-compute[71285]:   <serial>25bd1b47-9d43-46b2-9f81-5f2bc51cfb24</serial>
Apr 13 20:44:48 user nova-compute[71285]: </disk>
Apr 13 20:44:48 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:44:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:44:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:44:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] No VIF found with MAC fa:16:3e:f0:2a:ea, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:44:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d11d2dd8-843c-4916-9277-7612d806e764 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.582s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:44:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:44:59 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:02 user nova-compute[71285]: INFO nova.compute.manager [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Detaching volume 25bd1b47-9d43-46b2-9f81-5f2bc51cfb24
Apr 13 20:45:02 user nova-compute[71285]: INFO nova.virt.block_device [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Attempting to driver detach volume 25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 from mountpoint /dev/vdb
Apr 13 20:45:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Attempting to detach device vdb from instance 0865046e-7479-409c-9105-f202b4629851 from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:45:02 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:45:02 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:45:02 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:45:02 user nova-compute[71285]:   <serial>25bd1b47-9d43-46b2-9f81-5f2bc51cfb24</serial>
Apr 13 20:45:02 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:45:02 user nova-compute[71285]: </disk>
Apr 13 20:45:02 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:45:02 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully detached device vdb from instance 0865046e-7479-409c-9105-f202b4629851 from the persistent domain config.
Apr 13 20:45:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0865046e-7479-409c-9105-f202b4629851 from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:45:02 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:45:02 user nova-compute[71285]:   <source dev="/dev/sdc"/>
Apr 13 20:45:02 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:45:02 user nova-compute[71285]:   <serial>25bd1b47-9d43-46b2-9f81-5f2bc51cfb24</serial>
Apr 13 20:45:02 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:45:02 user nova-compute[71285]: </disk>
Apr 13 20:45:02 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418703.007249, 0865046e-7479-409c-9105-f202b4629851 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:45:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully detached device vdb from instance 0865046e-7479-409c-9105-f202b4629851 from the live domain config.
Apr 13 20:45:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZUgwGTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f19ec5-fc7e-485b-8624-af9e8867e069]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:45:03 user nova-compute[71285]: No targets found.
Apr 13 20:45:03 user nova-compute[71285]: iSNS:
Apr 13 20:45:03 user nova-compute[71285]: No targets found.
Apr 13 20:45:03 user nova-compute[71285]: STATIC:
Apr 13 20:45:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:45:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24
Apr 13 20:45:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:03 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:45:03 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:03 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:03 user nova-compute[71285]: FIRMWARE:
Apr 13 20:45:03 user nova-compute[71285]: No targets found.
Apr 13 20:45:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:45:03 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:45:03 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e0b7fa-d047-4aac-a457-6182d579669f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a48cd-3bbd-40c1-8ff2-f5512d0ada15]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:03 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:03 user nova-compute[71285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)
Apr 13 20:45:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:03 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:03 user nova-compute[71285]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 (non-flash)
Apr 13 20:45:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c209120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9f38d-4348-44fb-8c9f-6f30485d5a6b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e091c11c-abde-4109-9c05-78bbee00071b]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec29c53-2d5e-433f-af70-eff3ef545f70]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec832c-f429-41bc-92e8-edfaee4aedae]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8b6ad6-8a1e-4beb-b2a2-cb4e6c9717b3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c053d1c-a939-4473-9674-6d0314d8a949]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260]
Apr 13 20:45:03 user nova-compute[71285]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24, portal: 172.16.0.220,3260] successful.
Apr 13 20:45:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[57645fe0-8c50-4436-90b1-19dc6865e75b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== disconnect_volume: return (331ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'flavor' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4431e34c-72e4-44f8-b0c2-12b97c9c12dc tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.599s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "0865046e-7479-409c-9105-f202b4629851-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:04 user nova-compute[71285]: INFO nova.compute.manager [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Terminating instance
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing instance network info cache due to event network-changed-9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Acquiring lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Acquired lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.network.neutron [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Refreshing network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:04 user nova-compute[71285]: INFO nova.compute.manager [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Terminating instance
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-133fa6e7-dc3b-4d16-9d51-921d374929df req-0437ac6b-e2e2-4f35-8fb1-aa515f59e054 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:45:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updated VIF entry in instance network info cache for port 9c4f6683-1965-4f34-9834-9872c4f4ff98. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.neutron [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [{"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ed2b3ed1-9c3e-4728-bce2-e311206d8336 req-4742ddd6-a4f5-4dc7-acbb-3fce6c2159a4 service nova] Releasing lock "refresh_cache-f7253b3f-8d1c-4bf4-a591-5088074aafbe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 0865046e-7479-409c-9105-f202b4629851] Instance destroyed successfully.
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lazy-loading 'resources' on Instance uuid 0865046e-7479-409c-9105-f202b4629851 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Instance destroyed successfully.
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lazy-loading 'resources' on Instance uuid f7253b3f-8d1c-4bf4-a591-5088074aafbe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-530196953',display_name='tempest-VolumesSnapshotTestJSON-instance-530196953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-530196953',id=42,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:42:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a8f583cda274b8ba1e6383d1aa142d7',ramdisk_id='',reservation_id='r-lj0lf10o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2146034860',owner_user_name='tempest-VolumesSnapshotTestJSON-2146034860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:58Z,user_data=None,user_id='24880a07e48f4125b4a63048c6f5237b',uuid=0865046e-7479-409c-9105-f202b4629851,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converting VIF {"id": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "address": "fa:16:3e:f0:2a:ea", "network": {"id": "f480708b-bb2a-4e79-9d65-e09ce39d0c41", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1157759770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "0a8f583cda274b8ba1e6383d1aa142d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b33cac-43", "ovs_interfaceid": "b9b33cac-436e-4b27-a1ec-1ca5838c9c21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_vif [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9b33cac-43, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1476334002',display_name='tempest-TestVolumeBootPattern-server-1476334002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1476334002',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWzniVfeKUaahDQ/x5WKYKcwohikldr8bXCVCg/eMpnhk2exx+LeiEnogG5V1LjI1qGok6B8fyY6nOoTbF5NVo0FQ4J3GihDz3BDwFCoXVqh2bHfw7oEqVBbslkjVynrA==',key_name='tempest-TestVolumeBootPattern-1472807234',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65dc7126add94e0c97afbe225c8447a4',ramdisk_id='',reservation_id='r-a0ci8imh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2040418736',owner_user_name='tempest-TestVolumeBootPattern-2040418736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:40:26Z,user_data=None,user_id='7e478a11b57b4ee385e33c4709adf04b',uuid=f7253b3f-8d1c-4bf4-a591-5088074aafbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converting VIF {"id": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "address": "fa:16:3e:7b:49:5b", "network": {"id": "e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1427011022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65dc7126add94e0c97afbe225c8447a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f6683-19", "ovs_interfaceid": "9c4f6683-1965-4f34-9834-9872c4f4ff98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_vif [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c4f6683-19, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: INFO os_vif [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:2a:ea,bridge_name='br-int',has_traffic_filtering=True,id=b9b33cac-436e-4b27-a1ec-1ca5838c9c21,network=Network(f480708b-bb2a-4e79-9d65-e09ce39d0c41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9b33cac-43')
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EZUgwGTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:05 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:05 user nova-compute[71285]: INFO os_vif [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:49:5b,bridge_name='br-int',has_traffic_filtering=True,id=9c4f6683-1965-4f34-9834-9872c4f4ff98,network=Network(e0202123-ccbc-4bf3-b40d-4fe8c77e5eb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f6683-19')
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFHCWQaY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:05 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcd46d3-44ae-443c-b196-4af30059c1ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]: iSNS:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]: STATIC:
Apr 13 20:45:05 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:45:05 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:05 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:05 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:45:05 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:05 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:05 user nova-compute[71285]: FIRMWARE:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:45:05 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:45:05 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25bd1b47-9d43-46b2-9f81-5f2bc51cfb24', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb9fd6d-11c5-46a4-a80b-83c48b6b6655]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30bf01e-59c1-46ab-bff0-e77bb8616e27]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:05 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:05 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c299120>, {}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Disconnecting from: [] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.092s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] <== disconnect_volume: return (94ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Deleting instance files /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851_del
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Deletion of /opt/stack/data/nova/instances/0865046e-7479-409c-9105-f202b4629851_del complete
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.090s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2024b07e-3362-485d-8aad-bf009f06a846]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]: iSNS:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]: STATIC:
Apr 13 20:45:05 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:45:05 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:05 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:05 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c
Apr 13 20:45:05 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:05 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:05 user nova-compute[71285]: FIRMWARE:
Apr 13 20:45:05 user nova-compute[71285]: No targets found.
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:45:05 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:45:05 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3223a10-4020-40bc-b0dd-5df08ede4aff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.compute.manager [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 0865046e-7479-409c-9105-f202b4629851] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0865046e-7479-409c-9105-f202b4629851] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc2f00-64f4-4b13-bae5-fb342b83b0f9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:05 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c (non-flash)
Apr 13 20:45:05 user nova-compute[71285]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c208040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae1cad-ecca-432e-8491-8fdb799d35d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec0240b-047a-42a5-85c4-69b8db3a007d]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c2c3f7-a79f-4ec3-a3c3-491c44115123]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f36cd1-af9b-4cd8-b75b-26d8593f4066]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[db894ea7-65fd-4fe6-8039-d08e06ea1f35]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Error from libvirt while getting description of instance-0000002a: [Error Code 42] Domain not found: no domain with matching uuid '0865046e-7479-409c-9105-f202b4629851' (instance-0000002a): libvirt.libvirtError: Domain not found: no domain with matching uuid '0865046e-7479-409c-9105-f202b4629851' (instance-0000002a)
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6747cb-8880-4fb8-9aa9-837f1205ec85]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260]
Apr 13 20:45:05 user nova-compute[71285]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c, portal: 172.16.0.220,3260] successful.
Apr 13 20:45:05 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45e7808c-5141-44a8-bdae-b556a6b5578c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b660d-5980-407e-a800-7f2ff379c6df]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.433s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] <== disconnect_volume: return (522ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Deleting instance files /opt/stack/data/nova/instances/f7253b3f-8d1c-4bf4-a591-5088074aafbe_del
Apr 13 20:45:05 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Deletion of /opt/stack/data/nova/instances/f7253b3f-8d1c-4bf4-a591-5088074aafbe_del complete
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:06 user nova-compute[71285]: INFO nova.compute.manager [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Took 1.67 seconds to destroy the instance on the hypervisor.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 0865046e-7479-409c-9105-f202b4629851] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:45:06 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0865046e-7479-409c-9105-f202b4629851] Took 0.52 seconds to deallocate network for instance.
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.volume.cinder [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Attachment 38f25e6a-15e5-4ed8-845c-75ff65810492 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 38f25e6a-15e5-4ed8-845c-75ff65810492. (HTTP 404) (Request-ID: req-58966e3f-41eb-4ee4-b171-083bcf057e86)
Apr 13 20:45:06 user nova-compute[71285]: INFO nova.compute.manager [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] [instance: 0865046e-7479-409c-9105-f202b4629851] Took 0.03 seconds to detach 1 volumes for instance.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-vif-unplugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Acquiring lock "0865046e-7479-409c-9105-f202b4629851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] No waiting events found dispatching network-vif-unplugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received unexpected event network-vif-unplugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance with vm_state deleted and task_state None.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Acquiring lock "0865046e-7479-409c-9105-f202b4629851-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] Lock "0865046e-7479-409c-9105-f202b4629851-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] No waiting events found dispatching network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received unexpected event network-vif-plugged-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 for instance with vm_state deleted and task_state None.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-8403dd8e-35ce-4d6c-89e8-0d9a9a4effa0 req-e672bc54-2162-417e-b071-15cc379510d4 service nova] [instance: 0865046e-7479-409c-9105-f202b4629851] Received event network-vif-deleted-b9b33cac-436e-4b27-a1ec-1ca5838c9c21 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8432MB free_disk=26.32006072998047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Took 0.53 seconds to deallocate network for instance.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state active and task_state deleting.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state active and task_state deleting.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state active and task_state deleting.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-unplugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Acquiring lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] No waiting events found dispatching network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:45:06 user nova-compute[71285]: WARNING nova.compute.manager [req-f342c249-e3a5-4097-ad36-c228bf0e9003 req-8edd806f-653c-4f08-80db-66cdb97c59c9 service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received unexpected event network-vif-plugged-9c4f6683-1965-4f34-9834-9872c4f4ff98 for instance with vm_state active and task_state deleting.
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.712s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.301s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:06 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Deleted allocations for instance 0865046e-7479-409c-9105-f202b4629851
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance f7253b3f-8d1c-4bf4-a591-5088074aafbe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e026cb12-d278-44b7-a174-ce01a25ad7b1 tempest-VolumesSnapshotTestJSON-2146034860 tempest-VolumesSnapshotTestJSON-2146034860-project-member] Lock "0865046e-7479-409c-9105-f202b4629851" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.838s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:07 user nova-compute[71285]: INFO nova.compute.manager [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Took 0.80 seconds to detach 1 volumes for instance.
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:07 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Deleted allocations for instance f7253b3f-8d1c-4bf4-a591-5088074aafbe
Apr 13 20:45:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-05e00560-9ba6-4cff-b49f-996231e5d7e4 tempest-TestVolumeBootPattern-2040418736 tempest-TestVolumeBootPattern-2040418736-project-member] Lock "f7253b3f-8d1c-4bf4-a591-5088074aafbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.358s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [{"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-99cad31b-84d7-4b5b-b932-747848852c94" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-d3b7ae3f-9746-4b9f-9ef3-7c448b2ad0a3 req-fa6f25d0-7baa-4c72-95c8-e0075b1f60fc service nova] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Received event network-vif-deleted-9c4f6683-1965-4f34-9834-9872c4f4ff98 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:45:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:45:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:12 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418705.3087933, 0865046e-7479-409c-9105-f202b4629851 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:45:20 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 0865046e-7479-409c-9105-f202b4629851] VM Stopped (Lifecycle Event)
Apr 13 20:45:20 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418705.3114305, f7253b3f-8d1c-4bf4-a591-5088074aafbe => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:45:20 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] VM Stopped (Lifecycle Event)
Apr 13 20:45:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-c59b4ab1-88a0-49ac-98fd-da5c92a82ca9 None None] [instance: 0865046e-7479-409c-9105-f202b4629851] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-3f4a1ba8-a2bb-4f27-b7a6-860377b3b628 None None] [instance: f7253b3f-8d1c-4bf4-a591-5088074aafbe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:23 user nova-compute[71285]: DEBUG nova.objects.instance [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:24 user nova-compute[71285]: INFO nova.compute.manager [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attaching volume 3ce2d7b8-f928-4321-8a72-ec1f605cb147 to /dev/vdb
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.utils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd402014-4f0f-4789-995f-902ac66875f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327c654-808b-468f-ac0f-ed023d542977]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ff374-0b51-4d21-978a-d5054dc8726e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7d2db0-0cae-4c31-987d-c7df755e74d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:45:24 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:45:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed30db8-b066-451f-894c-73183c5a3222]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG os_brick.utils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:24 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating existing volume attachment record: bcba4ec3-b689-41e1-a700-6a43ee4ef18e {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:45:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKpkHhqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:28 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:28 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:28 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9412cc-8be4-4d28-814b-3fa502321c61]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:45:28 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[209fa538-cedf-42ae-8c77-f90265ade8cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147] added
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[137defaa-c8ec-4511-bb04-b853b534dd4e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487156c-caed-478a-8f42-37b4296eba3a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKpkHhqW {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKpkHhqW" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ec3323-2bdc-414a-a535-b230b35193ab]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xKpkHhqW'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e50e5a5-e647-405d-82dd-9211779a5b70]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ece9da2-4d82-49e4-9367-9f6c6e9f25df]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe49a31-5e4c-4cd0-8d08-bc56ce2a416d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260]
Apr 13 20:45:28 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260] successful.
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5234ae90-e4e8-4b9d-b6ff-9d74d9b152c1]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba231f-1b71-48c4-90fd-c89f730ad622]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)
Apr 13 20:45:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[afff0b87-50c3-49c8-9837-93e3dec06dd1]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:28 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 632463fb-75e1-458a-b9f7-8a19fdf7409b {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "99cad31b-84d7-4b5b-b932-747848852c94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "99cad31b-84d7-4b5b-b932-747848852c94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKpkHhqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23334346230303430', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334346230303430', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.objects.instance [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:45:29 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:45:29 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:45:29 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:45:29 user nova-compute[71285]:   <serial>3ce2d7b8-f928-4321-8a72-ec1f605cb147</serial>
Apr 13 20:45:29 user nova-compute[71285]: </disk>
Apr 13 20:45:29 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No VIF found with MAC fa:16:3e:4e:4d:3f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-80edfc29-9d09-47cd-ae3f-6d92a4159116 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.291s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.866s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:45:31 user nova-compute[71285]: INFO nova.compute.manager [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Detaching volume 3ce2d7b8-f928-4321-8a72-ec1f605cb147
Apr 13 20:45:31 user nova-compute[71285]: INFO nova.virt.block_device [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attempting to driver detach volume 3ce2d7b8-f928-4321-8a72-ec1f605cb147 from mountpoint /dev/vdb
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Attempting to detach device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:45:31 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:45:31 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:45:31 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:45:31 user nova-compute[71285]:   <serial>3ce2d7b8-f928-4321-8a72-ec1f605cb147</serial>
Apr 13 20:45:31 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:45:31 user nova-compute[71285]: </disk>
Apr 13 20:45:31 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:45:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config.
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:45:31 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:45:31 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:45:31 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:45:31 user nova-compute[71285]:   <serial>3ce2d7b8-f928-4321-8a72-ec1f605cb147</serial>
Apr 13 20:45:31 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:45:31 user nova-compute[71285]: </disk>
Apr 13 20:45:31 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418731.6793349, 38831b52-4793-489b-87ea-3bbad883758c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:45:31 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config.
Apr 13 20:45:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKpkHhqW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:45:31 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39bb75-82bd-4174-b286-4023d593e65c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:45:31 user nova-compute[71285]: No targets found.
Apr 13 20:45:31 user nova-compute[71285]: iSNS:
Apr 13 20:45:31 user nova-compute[71285]: No targets found.
Apr 13 20:45:31 user nova-compute[71285]: STATIC:
Apr 13 20:45:31 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:45:31 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:31 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:31 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147
Apr 13 20:45:31 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:45:31 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:45:31 user nova-compute[71285]: FIRMWARE:
Apr 13 20:45:31 user nova-compute[71285]: No targets found.
Apr 13 20:45:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:45:31 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:45:31 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c802fff-36d2-404a-8bdd-71df0269f06a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef386e-6699-4d7f-97f9-82ad65c92c96]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:31 user nova-compute[71285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)
Apr 13 20:45:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:45:31 user nova-compute[71285]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 (non-flash)
Apr 13 20:45:31 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c299480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc568908-943c-48d9-a91a-d41174b69622]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd012bd-d7d2-4b23-899c-cf16d8ceaa24]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[208906a8-2d9d-4115-bbd4-1402035b8c4d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8788f1-42c3-4543-961a-99c04b2c7723]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9751cc30-9a40-4c1b-b707-f500bd26951c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5684330-3b3e-49c5-9259-4f7a2e8cb5bc]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260]
Apr 13 20:45:32 user nova-compute[71285]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147, portal: 172.16.0.220,3260] successful.
Apr 13 20:45:32 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce2d7b8-f928-4321-8a72-ec1f605cb147 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678c300-4fd8-4a1e-bb41-a81e04552933]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== disconnect_volume: return (360ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG nova.objects.instance [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:45:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-c0aa4ec4-7be1-48eb-84d5-4d88943ccee0 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:45:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:52 user nova-compute[71285]: INFO nova.compute.manager [None req-4ec48760-9904-4999-a597-021585de7aff tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Get console output
Apr 13 20:45:53 user nova-compute[71285]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:45:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:45:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:00 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:46:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:46:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=26.336021423339844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 99cad31b-84d7-4b5b-b932-747848852c94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:46:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:46:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:46:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:46:08 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:46:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:46:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:46:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:46:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:13 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:46:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG nova.objects.instance [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:24 user nova-compute[71285]: INFO nova.compute.manager [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attaching volume 5690bf06-3948-4710-adc5-a9ea83e171b6 to /dev/vdb
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.utils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e584cf-40fe-42d0-9f27-b83e2d049959]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab955fa2-f752-4200-bdfc-ded6ec2dcdde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e37fc25-ab09-4414-bae0-f90c15b39ec5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[37543388-4de8-4287-ac3b-179a4b6107e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:46:24 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:46:24 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8297b2ba-0007-41f0-9943-68b1c4297699]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG os_brick.utils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:46:24 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating existing volume attachment record: b18a1663-78fe-40fc-9163-1d89ebc38728 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:46:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdxzbrfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:46:28 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:46:28 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:46:28 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6baafb-fc31-40dd-bba2-4cd89e6aa0e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:46:28 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[10217c79-b51c-484f-92b8-1030db927ade]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6] added
Apr 13 20:46:28 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:28 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb94d7d-8a06-4065-a1d6-3e25136287a5]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb617a-cd9d-4ba9-b1a0-6dba29ec09db]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdxzbrfM {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdxzbrfM" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1bc557-fa3a-452f-ac58-cdeda8a51414]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdxzbrfM'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f70c6ca-ccb4-45fc-8570-b8f71dce3d75]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491127b-df74-49cd-9574-543ec9fad506]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc75e92a-edc4-4a25-9ba7-3f6fad5f0524]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260]
Apr 13 20:46:29 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260] successful.
Apr 13 20:46:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbcc1dc-e812-4590-96dc-49c21bb0f69f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[348ac28a-383f-48a6-8e7b-27eacc798ac8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)
Apr 13 20:46:29 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73c6f03-fe68-4d1a-aee0-a92efe0cb335]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:46:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdxzbrfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23932303930323336', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932303930323336', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.objects.instance [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:46:30 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:46:30 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:46:30 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:46:30 user nova-compute[71285]:   <serial>5690bf06-3948-4710-adc5-a9ea83e171b6</serial>
Apr 13 20:46:30 user nova-compute[71285]: </disk>
Apr 13 20:46:30 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No VIF found with MAC fa:16:3e:4e:4d:3f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:46:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-216562c8-5eec-453a-8359-e463c463d64c tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.493s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:32 user nova-compute[71285]: INFO nova.compute.manager [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Detaching volume 5690bf06-3948-4710-adc5-a9ea83e171b6
Apr 13 20:46:33 user nova-compute[71285]: INFO nova.virt.block_device [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attempting to driver detach volume 5690bf06-3948-4710-adc5-a9ea83e171b6 from mountpoint /dev/vdb
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Attempting to detach device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:46:33 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:46:33 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:46:33 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:46:33 user nova-compute[71285]:   <serial>5690bf06-3948-4710-adc5-a9ea83e171b6</serial>
Apr 13 20:46:33 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:46:33 user nova-compute[71285]: </disk>
Apr 13 20:46:33 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:46:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config.
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:46:33 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:46:33 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:46:33 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:46:33 user nova-compute[71285]:   <serial>5690bf06-3948-4710-adc5-a9ea83e171b6</serial>
Apr 13 20:46:33 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:46:33 user nova-compute[71285]: </disk>
Apr 13 20:46:33 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418793.4799879, 38831b52-4793-489b-87ea-3bbad883758c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:46:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config.
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdxzbrfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:46:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd9851-9e80-441a-846f-0728fa754ea7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:46:33 user nova-compute[71285]: No targets found.
Apr 13 20:46:33 user nova-compute[71285]: iSNS:
Apr 13 20:46:33 user nova-compute[71285]: No targets found.
Apr 13 20:46:33 user nova-compute[71285]: STATIC:
Apr 13 20:46:33 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:46:33 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:46:33 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:46:33 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6
Apr 13 20:46:33 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:46:33 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:46:33 user nova-compute[71285]: FIRMWARE:
Apr 13 20:46:33 user nova-compute[71285]: No targets found.
Apr 13 20:46:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:46:33 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:46:33 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb696169-8fc9-49d1-b809-eb1dc2d9d9b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29012c3-d11c-417f-bf99-e73325052240]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:33 user nova-compute[71285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)
Apr 13 20:46:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:33 user nova-compute[71285]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 (non-flash)
Apr 13 20:46:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70b8bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d5cecd-3dab-4e8d-9552-41ad0dd6d913]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a203872-3625-48fe-85c4-5aea0ff5fc4c]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b5e40c-b879-45b2-9b56-2d3787fd28f4]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adbe544-4132-4adb-b6a5-f31819280dbd]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f6b8a-9b1c-4756-b034-ff8c7e1c0206]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad827d13-0ba2-43bd-9aa3-cf8fb64484ae]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260]
Apr 13 20:46:33 user nova-compute[71285]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6, portal: 172.16.0.220,3260] successful.
Apr 13 20:46:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5690bf06-3948-4710-adc5-a9ea83e171b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefee869-818c-400f-9534-2a592703b03f]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== disconnect_volume: return (264ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:46:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:46:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:46:34 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a591cb11-3b7e-4021-9e04-c48c031e6b83 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.692s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:46:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:53 user nova-compute[71285]: INFO nova.compute.manager [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Terminating instance
Apr 13 20:46:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:46:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-b8f49d8c-afc4-41b4-b1c2-546327e7e651 req-c138e568-ef02-4c60-858b-41bf6e94f697 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-unplugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:46:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Instance destroyed successfully.
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid 99cad31b-84d7-4b5b-b932-747848852c94 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:40:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-689800020',display_name='tempest-ServerActionsTestJSON-server-689800020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-689800020',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:42:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-qfpnsg4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:44:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=99cad31b-84d7-4b5b-b932-747848852c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "0bead699-f8a2-4731-bd2f-145f524e77b6", "address": "fa:16:3e:60:35:ef", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bead699-f8", "ovs_interfaceid": "0bead699-f8a2-4731-bd2f-145f524e77b6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_vif [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bead699-f8, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:46:54 user nova-compute[71285]: INFO os_vif [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:35:ef,bridge_name='br-int',has_traffic_filtering=True,id=0bead699-f8a2-4731-bd2f-145f524e77b6,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bead699-f8')
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LYTpfJul', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:46:54 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7771b7-f7e8-4b3a-89c4-c90401fb8874]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:46:54 user nova-compute[71285]: No targets found.
Apr 13 20:46:54 user nova-compute[71285]: iSNS:
Apr 13 20:46:54 user nova-compute[71285]: No targets found.
Apr 13 20:46:54 user nova-compute[71285]: STATIC:
Apr 13 20:46:54 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350
Apr 13 20:46:54 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:46:54 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:46:54 user nova-compute[71285]: FIRMWARE:
Apr 13 20:46:54 user nova-compute[71285]: No targets found.
Apr 13 20:46:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:46:54 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:46:54 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[127a3447-639f-4e89-8084-4a13c6b2246c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb760fb7-500f-4cac-a06d-5fc06e9ca121]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 (non-flash)
Apr 13 20:46:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc70a75240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350'): ({'sdd'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Removing single pathed devices sdd {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c17886-4592-4d95-90f1-470acc969637]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d46eb4-95ee-484a-8f90-8dd22df63fea]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Flushing IO for device /dev/sdd {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c45cf41-ac1b-4aa4-bdc3-8624b416c089]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a45c5b-bfad-4f6d-8955-e2e8de3ac80b]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] SCSI volumes sdd have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26231353833613033', '/dev/disk/by-id/scsi-1SCST_BIOd7aebb7e-b1583a03ba6bc720', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d7aebb7e') {{(pid=81283) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd9705-40ca-4db3-9626-c7620da2d5b4]: (4, None) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2490d0c-c2bb-4caa-9dad-f25b3dd5536c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be1786b-0607-459b-81fc-86b698223596]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260]
Apr 13 20:46:54 user nova-compute[71285]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350, portal: 172.16.0.220,3260] successful.
Apr 13 20:46:54 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151cb5ac-eddd-4883-ba83-7fbee0f2d350 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[165546f6-e39a-44de-9caf-e8e975d7ee99]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] <== disconnect_volume: return (308ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:46:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:46:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Deleting instance files /opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94_del
Apr 13 20:46:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Deletion of /opt/stack/data/nova/instances/99cad31b-84d7-4b5b-b932-747848852c94_del complete
Apr 13 20:46:55 user nova-compute[71285]: INFO nova.compute.manager [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 13 20:46:55 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:46:55 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:46:55 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:46:55 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:46:55 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Took 0.85 seconds to deallocate network for instance.
Apr 13 20:46:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-699be368-0e11-48a7-aaab-14ba6f60392b req-abfe96dd-1e53-4eef-93fd-d0796b5f3c45 service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-deleted-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Acquiring lock "99cad31b-84d7-4b5b-b932-747848852c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] Lock "99cad31b-84d7-4b5b-b932-747848852c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] No waiting events found dispatching network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:46:56 user nova-compute[71285]: WARNING nova.compute.manager [req-ca44e6e4-3262-4200-9e8f-fc20754b673c req-537a9729-b0af-427b-baa4-555f9a99f12b service nova] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Received unexpected event network-vif-plugged-0bead699-f8a2-4731-bd2f-145f524e77b6 for instance with vm_state active and task_state deleting.
Apr 13 20:46:56 user nova-compute[71285]: INFO nova.compute.manager [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Took 0.83 seconds to detach 1 volumes for instance.
Apr 13 20:46:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Deleting volume: 151cb5ac-eddd-4883-ba83-7fbee0f2d350 {{(pid=71285) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:46:56 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:46:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:57 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Deleted allocations for instance 99cad31b-84d7-4b5b-b932-747848852c94
Apr 13 20:46:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-6b047e84-8537-4995-9e74-3ed8de0c7147 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "99cad31b-84d7-4b5b-b932-747848852c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:46:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:46:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:01 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:05 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:47:06 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=26.317703247070312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 632463fb-75e1-458a-b9f7-8a19fdf7409b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:47:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:47:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 20:47:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:09 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418814.6114986, 99cad31b-84d7-4b5b-b932-747848852c94 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:47:09 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] VM Stopped (Lifecycle Event)
Apr 13 20:47:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4562acd4-e40c-44c3-8d0f-b75fca7c2081 None None] [instance: 99cad31b-84d7-4b5b-b932-747848852c94] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:47:09 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:47:14 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:47:19 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:47:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:25 user nova-compute[71285]: INFO nova.compute.manager [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attaching volume 5960e646-9ff4-4019-b4c1-b5ab3f92a71e to /dev/vdb
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.utils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa9ffed-67aa-42f2-93da-02faacef1730]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9753d4d9-9511-4973-911a-1bf4809a50d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530e6bd-1dd6-4a51-be2b-5e9193d2c6aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[078bc570-1585-42f5-92cf-fc61b9728ef7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:47:25 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:47:25 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9bb93-130f-4404-9f3f-75922fe3d684]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG os_brick.utils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:47:25 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating existing volume attachment record: 9ab535e3-3164-479e-a12b-7da2cf89f1fa {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:47:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:29 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFBVrgSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:47:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:47:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:47:30 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b3c75a-722d-48ca-aaae-988fb026809b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:47:30 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42842b-8a05-4ff9-8c4e-c9abf3e39556]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e] added
Apr 13 20:47:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4115b7-1314-410f-8b9d-5c4382c6ddb8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbcf0b6-6a9a-4a30-993f-c4acb58327ae]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFBVrgSJ {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kFBVrgSJ" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b5e77-2711-40e0-8a58-e549791d8fd6]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kFBVrgSJ'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d548a1-ebf6-462d-b086-7a9ba05daf1c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[87418acc-c81a-484a-a274-4e7dc0420a24]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:47:30 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:47:30 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:47:30 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:47:30 user nova-compute[71285]: 
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd8e95-8bef-4df8-a366-5647c8634981]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260]
Apr 13 20:47:30 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260] successful.
Apr 13 20:47:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c40559a-5df3-458e-9de6-f778279ca97b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[659028cb-772e-4b62-806a-e7372ac24ccf]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)
Apr 13 20:47:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)
Apr 13 20:47:30 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b068ae-a42c-4e6f-91eb-8f1dc567c34e]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:47:30 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFBVrgSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23634613365633232', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634613365633232', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] attach device xml: <disk type="block" device="disk">
Apr 13 20:47:31 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:47:31 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:47:31 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:47:31 user nova-compute[71285]:   <serial>5960e646-9ff4-4019-b4c1-b5ab3f92a71e</serial>
Apr 13 20:47:31 user nova-compute[71285]: </disk>
Apr 13 20:47:31 user nova-compute[71285]:  {{(pid=71285) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:47:31 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] No VIF found with MAC fa:16:3e:4e:4d:3f, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:47:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1032607e-faa0-4000-9785-157c237f1133 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.323s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:33 user nova-compute[71285]: INFO nova.compute.manager [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Detaching volume 5960e646-9ff4-4019-b4c1-b5ab3f92a71e
Apr 13 20:47:33 user nova-compute[71285]: INFO nova.virt.block_device [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Attempting to driver detach volume 5960e646-9ff4-4019-b4c1-b5ab3f92a71e from mountpoint /dev/vdb
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Attempting to detach device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config. {{(pid=71285) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:47:33 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:47:33 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:47:33 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:47:33 user nova-compute[71285]:   <serial>5960e646-9ff4-4019-b4c1-b5ab3f92a71e</serial>
Apr 13 20:47:33 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:47:33 user nova-compute[71285]: </disk>
Apr 13 20:47:33 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:47:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the persistent domain config.
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config. {{(pid=71285) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] detach device xml: <disk type="block" device="disk">
Apr 13 20:47:33 user nova-compute[71285]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:47:33 user nova-compute[71285]:   <source dev="/dev/sdb"/>
Apr 13 20:47:33 user nova-compute[71285]:   <target dev="vdb" bus="virtio"/>
Apr 13 20:47:33 user nova-compute[71285]:   <serial>5960e646-9ff4-4019-b4c1-b5ab3f92a71e</serial>
Apr 13 20:47:33 user nova-compute[71285]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 13 20:47:33 user nova-compute[71285]: </disk>
Apr 13 20:47:33 user nova-compute[71285]:  {{(pid=71285) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Received event <DeviceRemovedEvent: 1681418853.784729, 38831b52-4793-489b-87ea-3bbad883758c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71285) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 13 20:47:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully detached device vdb from instance 38831b52-4793-489b-87ea-3bbad883758c from the live domain config.
Apr 13 20:47:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kFBVrgSJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:47:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1275f5e2-66e8-40b2-b8d2-f8bc11935639]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 20:47:33 user nova-compute[71285]: No targets found.
Apr 13 20:47:33 user nova-compute[71285]: iSNS:
Apr 13 20:47:33 user nova-compute[71285]: No targets found.
Apr 13 20:47:33 user nova-compute[71285]: STATIC:
Apr 13 20:47:33 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e
Apr 13 20:47:33 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 20:47:33 user nova-compute[71285]:                 Iface Name: default
Apr 13 20:47:33 user nova-compute[71285]: FIRMWARE:
Apr 13 20:47:33 user nova-compute[71285]: No targets found.
Apr 13 20:47:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 20:47:33 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 20:47:33 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f3d16-40cc-4aeb-a7f7-afc2107d7635]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8bb052-6bcf-49f5-966c-07ba0ac3b9a5]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)
Apr 13 20:47:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e (non-flash)
Apr 13 20:47:33 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc5c209510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b2566-944d-46af-b72d-95a58ea86620]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff719fe-c4a1-4c56-a99f-0683e22ec2d3]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2469f-9093-42fd-8761-c61d5c02e594]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[33074b78-ce60-48fd-bf81-928c44604398]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[38730d73-19c7-4db5-8375-c0edad86d27b]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f17eb9b-0458-432b-a3a3-dd1369522a21]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260]
Apr 13 20:47:34 user nova-compute[71285]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e, portal: 172.16.0.220,3260] successful.
Apr 13 20:47:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5960e646-9ff4-4019-b4c1-b5ab3f92a71e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc2b5f-6374-4f7f-8b3e-0e14b4605194]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] <== disconnect_volume: return (282ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:34 user nova-compute[71285]: DEBUG nova.objects.instance [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'flavor' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:47:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-af05a6d4-24c6-4469-92fb-c04ad64f9b93 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.882s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:39 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:44 user nova-compute[71285]: INFO nova.compute.manager [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Terminating instance
Apr 13 20:47:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-unplugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] No waiting events found dispatching network-vif-unplugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-06d2439b-be43-4356-8f3e-68f2a6ff8ea7 req-0d7dd97b-291d-4ba2-aabd-172b2bddc91e service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-unplugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:47:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Instance destroyed successfully.
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lazy-loading 'resources' on Instance uuid 632463fb-75e1-458a-b9f7-8a19fdf7409b {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:38:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2071843580',display_name='tempest-ServerActionsTestJSON-server-2071843580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2071843580',id=36,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8XQHKydgkwWfalQ29Zgpt6SrMLlbFV9cdDGJaH227pfu23xIq2K9sHrzEhALiAbGrt7Y6D14X+cWcVflJ7cIsp6dIKidrngJr8bFc0aKtDhTerIQgud0ZbulwEHz6xpg==',key_name='tempest-keypair-514913657',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:38:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e9553d7d1f49f68d3b20cb647f2062',ramdisk_id='',reservation_id='r-ij6ja4vy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1522960802',owner_user_name='tempest-ServerActionsTestJSON-1522960802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:38:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04d351d2822a460d93748b98161d730c',uuid=632463fb-75e1-458a-b9f7-8a19fdf7409b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converting VIF {"id": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "address": "fa:16:3e:eb:f7:17", "network": {"id": "7ed2080d-9ecb-4275-aacd-107663b5cf3a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1510203142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e9553d7d1f49f68d3b20cb647f2062", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ca2b192-68", "ovs_interfaceid": "1ca2b192-684d-4058-9a5a-8345a6e2cc3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG os_vif [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ca2b192-68, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:47:45 user nova-compute[71285]: INFO os_vif [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f7:17,bridge_name='br-int',has_traffic_filtering=True,id=1ca2b192-684d-4058-9a5a-8345a6e2cc3c,network=Network(7ed2080d-9ecb-4275-aacd-107663b5cf3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ca2b192-68')
Apr 13 20:47:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Deleting instance files /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b_del
Apr 13 20:47:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Deletion of /opt/stack/data/nova/instances/632463fb-75e1-458a-b9f7-8a19fdf7409b_del complete
Apr 13 20:47:45 user nova-compute[71285]: INFO nova.compute.manager [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:47:45 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Took 0.49 seconds to deallocate network for instance.
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-47dedb25-ad5d-4384-bb02-e502b7d67861 req-cb9cf585-d0f2-4fe0-a50e-e519884acc76 service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-deleted-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:47:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:46 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Deleted allocations for instance 632463fb-75e1-458a-b9f7-8a19fdf7409b
Apr 13 20:47:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-d68aa3f0-d9fc-4974-9286-5bb7ab3c2fa2 tempest-ServerActionsTestJSON-1522960802 tempest-ServerActionsTestJSON-1522960802-project-member] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.734s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:47:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Acquiring lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:47:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:47:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] Lock "632463fb-75e1-458a-b9f7-8a19fdf7409b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:47:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] No waiting events found dispatching network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:47:47 user nova-compute[71285]: WARNING nova.compute.manager [req-fbe7e9af-1f50-42f4-896a-6ce8372f9290 req-862ddc8b-660e-499d-91f4-1a84844a98fd service nova] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Received unexpected event network-vif-plugged-1ca2b192-684d-4058-9a5a-8345a6e2cc3c for instance with vm_state deleted and task_state None.
Apr 13 20:47:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:47:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:00 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418865.1853998, 632463fb-75e1-458a-b9f7-8a19fdf7409b => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:48:00 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] VM Stopped (Lifecycle Event)
Apr 13 20:48:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-624bfe1b-fa86-46e3-bd18-3cf279a57869 None None] [instance: 632463fb-75e1-458a-b9f7-8a19fdf7409b] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:48:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:02 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:48:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:48:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8765MB free_disk=26.336231231689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 38831b52-4793-489b-87ea-3bbad883758c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:48:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:48:09 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:48:10 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:48:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:48:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:48:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:13 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:48:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:48:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:48:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing instance network info cache due to event network-changed-0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:48:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Acquiring lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:48:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Acquired lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:48:38 user nova-compute[71285]: DEBUG nova.network.neutron [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Refreshing network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:48:39 user nova-compute[71285]: DEBUG nova.network.neutron [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updated VIF entry in instance network info cache for port 0b225740-55dc-4bb0-be66-3c40b7a25e61. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:48:39 user nova-compute[71285]: DEBUG nova.network.neutron [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [{"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:48:39 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-55b589d8-9b3b-4bf9-8247-f0c59f2c8c6c req-9f34a6f7-7adf-44bf-8fdd-1fd174a16598 service nova] Releasing lock "refresh_cache-38831b52-4793-489b-87ea-3bbad883758c" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:48:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:43 user nova-compute[71285]: INFO nova.compute.manager [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Terminating instance
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.compute.manager [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-unplugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] No waiting events found dispatching network-vif-unplugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.compute.manager [req-dd1c1015-9812-4a7c-94d5-f33485b48b60 req-e524d1e8-3427-4ba0-b9b5-8bc71ba5a1d3 service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-unplugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 20:48:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Instance destroyed successfully.
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lazy-loading 'resources' on Instance uuid 38831b52-4793-489b-87ea-3bbad883758c {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:42:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1608632534',display_name='tempest-SnapshotDataIntegrityTests-server-1608632534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1608632534',id=41,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhOXBhf1EREMfWw7824K/m7ZWHva0Ib5kxoZBf1y/rD1+0w3EsV+DCuV1OLOfRq+SzB9mv575SLDbT1jgnsX+C2g9/ev6CIwZ+Gjd/H3yMnneQrMldzCHPrXL8Xq9ML6w==',key_name='tempest-SnapshotDataIntegrityTests-1395940804',keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:42:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='078e29f3a0914d2492f7ff5ac6083859',ramdisk_id='',reservation_id='r-bwgplzty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1436433817',owner_user_name='tempest-SnapshotDataIntegrityTests-1436433817-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:42:28Z,user_data=None,user_id='d37c755040ea402f96618b587efb5dca',uuid=38831b52-4793-489b-87ea-3bbad883758c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converting VIF {"id": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "address": "fa:16:3e:4e:4d:3f", "network": {"id": "2b2871d3-a109-479e-89b1-8c8528fb7c37", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1017796736-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078e29f3a0914d2492f7ff5ac6083859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b225740-55", "ovs_interfaceid": "0b225740-55dc-4bb0-be66-3c40b7a25e61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG os_vif [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b225740-55, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:43 user nova-compute[71285]: INFO os_vif [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:4d:3f,bridge_name='br-int',has_traffic_filtering=True,id=0b225740-55dc-4bb0-be66-3c40b7a25e61,network=Network(2b2871d3-a109-479e-89b1-8c8528fb7c37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b225740-55')
Apr 13 20:48:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Deleting instance files /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c_del
Apr 13 20:48:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Deletion of /opt/stack/data/nova/instances/38831b52-4793-489b-87ea-3bbad883758c_del complete
Apr 13 20:48:43 user nova-compute[71285]: INFO nova.compute.manager [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 20:48:43 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 20:48:43 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:48:44 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Took 0.73 seconds to deallocate network for instance.
Apr 13 20:48:44 user nova-compute[71285]: DEBUG nova.compute.manager [req-1d17fb37-4348-44fa-99d6-5d4afdb4db25 req-247f3f4f-871f-480e-bfbf-8d8cf3a8760c service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-deleted-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:48:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:44 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Deleted allocations for instance 38831b52-4793-489b-87ea-3bbad883758c
Apr 13 20:48:44 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-1d863215-277a-40fb-99b4-cb5c177c9b13 tempest-SnapshotDataIntegrityTests-1436433817 tempest-SnapshotDataIntegrityTests-1436433817-project-member] Lock "38831b52-4793-489b-87ea-3bbad883758c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.853s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Acquiring lock "38831b52-4793-489b-87ea-3bbad883758c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] Lock "38831b52-4793-489b-87ea-3bbad883758c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] No waiting events found dispatching network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:48:45 user nova-compute[71285]: WARNING nova.compute.manager [req-8136c46f-d7b1-4c84-a671-200d9c687acf req-649e8825-c719-4482-809e-201a5d6f84ad service nova] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Received unexpected event network-vif-plugged-0b225740-55dc-4bb0-be66-3c40b7a25e61 for instance with vm_state deleted and task_state None.
Apr 13 20:48:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:49 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:48:53 user nova-compute[71285]: INFO nova.compute.claims [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Claim successful on node user
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:48:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.policy [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:48:54 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Creating image(s)
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk 1073741824" returned: 0 in 0.051s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Cannot resize image /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.objects.instance [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'migration_context' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Successfully created port: 7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Ensure instance console log exists: /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Successfully updated port: 7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-changed-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Refreshing instance network info cache due to event network-changed-7010d8a1-cb74-49c7-9be0-dc0da456ad67. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.network.neutron [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Instance network_info: |[{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.network.neutron [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Refreshing network info cache for port 7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:48:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Start _get_guest_xml network_info=[{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:48:56 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:48:56 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-48633921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-48633921',id=43,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ym17o2to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:48:54Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=fe45ba7c-ccc0-4eaa-930c-6600e036f3e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.objects.instance [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:48:56 user nova-compute[71285]:   <uuid>fe45ba7c-ccc0-4eaa-930c-6600e036f3e9</uuid>
Apr 13 20:48:56 user nova-compute[71285]:   <name>instance-0000002b</name>
Apr 13 20:48:56 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:48:56 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:48:56 user nova-compute[71285]:   <metadata>
Apr 13 20:48:56 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:48:56 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-48633921</nova:name>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:48:56</nova:creationTime>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:48:56 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:48:56 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:owner>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 20:48:56 user nova-compute[71285]:       </nova:owner>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:48:56 user nova-compute[71285]:       <nova:ports>
Apr 13 20:48:56 user nova-compute[71285]:         <nova:port uuid="7010d8a1-cb74-49c7-9be0-dc0da456ad67">
Apr 13 20:48:56 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 13 20:48:56 user nova-compute[71285]:         </nova:port>
Apr 13 20:48:56 user nova-compute[71285]:       </nova:ports>
Apr 13 20:48:56 user nova-compute[71285]:     </nova:instance>
Apr 13 20:48:56 user nova-compute[71285]:   </metadata>
Apr 13 20:48:56 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:48:56 user nova-compute[71285]:     <system>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="serial">fe45ba7c-ccc0-4eaa-930c-6600e036f3e9</entry>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="uuid">fe45ba7c-ccc0-4eaa-930c-6600e036f3e9</entry>
Apr 13 20:48:56 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:48:56 user nova-compute[71285]:     </system>
Apr 13 20:48:56 user nova-compute[71285]:   </sysinfo>
Apr 13 20:48:56 user nova-compute[71285]:   <os>
Apr 13 20:48:56 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:48:56 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:48:56 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:48:56 user nova-compute[71285]:   </os>
Apr 13 20:48:56 user nova-compute[71285]:   <features>
Apr 13 20:48:56 user nova-compute[71285]:     <acpi/>
Apr 13 20:48:56 user nova-compute[71285]:     <apic/>
Apr 13 20:48:56 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:48:56 user nova-compute[71285]:   </features>
Apr 13 20:48:56 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:48:56 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:48:56 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:48:56 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:48:56 user nova-compute[71285]:   </clock>
Apr 13 20:48:56 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:48:56 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:48:56 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:48:56 user nova-compute[71285]:   </cpu>
Apr 13 20:48:56 user nova-compute[71285]:   <devices>
Apr 13 20:48:56 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:48:56 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:48:56 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk"/>
Apr 13 20:48:56 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:48:56 user nova-compute[71285]:     </disk>
Apr 13 20:48:56 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:48:56 user nova-compute[71285]:       <mac address="fa:16:3e:2a:7b:94"/>
Apr 13 20:48:56 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:48:56 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:48:56 user nova-compute[71285]:       <target dev="tap7010d8a1-cb"/>
Apr 13 20:48:56 user nova-compute[71285]:     </interface>
Apr 13 20:48:56 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:48:56 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/console.log" append="off"/>
Apr 13 20:48:56 user nova-compute[71285]:     </serial>
Apr 13 20:48:56 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:48:56 user nova-compute[71285]:     <video>
Apr 13 20:48:56 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:48:56 user nova-compute[71285]:     </video>
Apr 13 20:48:56 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:48:56 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:48:56 user nova-compute[71285]:     </rng>
Apr 13 20:48:56 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:48:56 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:48:56 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:48:56 user nova-compute[71285]:     </memballoon>
Apr 13 20:48:56 user nova-compute[71285]:   </devices>
Apr 13 20:48:56 user nova-compute[71285]: </domain>
Apr 13 20:48:56 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-48633921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-48633921',id=43,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ym17o2to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:48:54Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=fe45ba7c-ccc0-4eaa-930c-6600e036f3e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG os_vif [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7010d8a1-cb, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7010d8a1-cb, col_values=(('external_ids', {'iface-id': '7010d8a1-cb74-49c7-9be0-dc0da456ad67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:7b:94', 'vm-uuid': 'fe45ba7c-ccc0-4eaa-930c-6600e036f3e9'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:56 user nova-compute[71285]: INFO os_vif [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb')
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:2a:7b:94, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.neutron [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated VIF entry in instance network info cache for port 7010d8a1-cb74-49c7-9be0-dc0da456ad67. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG nova.network.neutron [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:48:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3b29edc3-5c48-4efa-95f2-d272e2393b5b req-26dd41b2-9a88-4aa2-b986-348a414673fc service nova] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] No waiting events found dispatching network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:48:57 user nova-compute[71285]: WARNING nova.compute.manager [req-24013d37-206e-46d5-8c78-ff18c673f91a req-a31bea36-caa8-430b-b0b0-86a9ee04e81d service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received unexpected event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance with vm_state building and task_state spawning.
Apr 13 20:48:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:48:58 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681418923.7810721, 38831b52-4793-489b-87ea-3bbad883758c => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:48:58 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 38831b52-4793-489b-87ea-3bbad883758c] VM Stopped (Lifecycle Event)
Apr 13 20:48:58 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e2574321-7b00-421e-b68a-e588b2de627f None None] [instance: 38831b52-4793-489b-87ea-3bbad883758c] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418939.5381513, fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] VM Resumed (Lifecycle Event)
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Instance spawned successfully.
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681418939.539498, fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] VM Started (Lifecycle Event)
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Took 5.36 seconds to spawn the instance on the hypervisor.
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:48:59 user nova-compute[71285]: INFO nova.compute.manager [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Took 5.86 seconds to build instance.
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:48:59 user nova-compute[71285]: DEBUG nova.compute.manager [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] No waiting events found dispatching network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:48:59 user nova-compute[71285]: WARNING nova.compute.manager [req-3705c967-7b5b-4164-9139-7fedf1d5bc7c req-65f7058b-9850-4030-ae35-1b50c4689ad8 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received unexpected event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance with vm_state active and task_state None.
Apr 13 20:48:59 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-908e92cc-6fdd-4097-8cbc-4c13546eaa12 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.956s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:49:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:04 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:49:06 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:49:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:49:07 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8723MB free_disk=26.345111846923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:49:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:49:11 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:49:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:49:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:49:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:50:03 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:08 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:09 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:50:09 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=26.32422637939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:50:09 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:50:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:50:13 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:50:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:18 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:50:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:50:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:50:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:50:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:50:44 user nova-compute[71285]: INFO nova.compute.manager [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] instance snapshotting
Apr 13 20:50:44 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Beginning live snapshot process
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c.delta 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c.delta 1073741824" returned: 0 in 0.058s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 20:50:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:50:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:50:46 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:50:46 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 20:50:46 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:50:46 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c.delta /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:50:47 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c.delta /opt/stack/data/nova/instances/snapshots/tmpgq58ne5e/15f0a09960c94b0b9f7a85b27d0a754c" returned: 0 in 0.388s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:50:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Snapshot extracted, beginning image upload
Apr 13 20:50:49 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Snapshot image upload complete
Apr 13 20:50:49 user nova-compute[71285]: INFO nova.compute.manager [None req-4c9479bd-fa98-441b-9a40-afb2f516e959 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Took 4.57 seconds to snapshot the instance on the hypervisor.
Apr 13 20:50:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:50:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:05 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:51:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:51:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8833MB free_disk=26.287456512451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:51:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:51:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:20 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:51:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:51:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:51:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:51:51 user nova-compute[71285]: INFO nova.compute.claims [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Claim successful on node user
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:51:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:51:51 user nova-compute[71285]: INFO nova.virt.block_device [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Booting with blank volume at /dev/vda
Apr 13 20:51:51 user nova-compute[71285]: DEBUG nova.policy [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:51:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Successfully created port: ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Successfully updated port: ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-changed-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG nova.compute.manager [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Refreshing instance network info cache due to event network-changed-ca77217a-aa63-4648-a54c-9f4d807d1acb. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:51:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance network_info: |[{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Refreshing network info cache for port ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated VIF entry in instance network info cache for port ca77217a-aa63-4648-a54c-9f4d807d1acb. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG nova.network.neutron [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:51:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-eab8bc6a-ba37-4500-a959-ce32856e7b93 req-d9640c4d-b898-4021-95eb-3befcc83c94f service nova] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:51:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba9ce81-3ad9-4aac-bda2-8bcef64609a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c51057-67a9-4c1f-9361-22894601efea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[635f78e9-26f9-4d38-8729-2d6caaf92ba4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fdc4ee-74f8-4c82-a7b7-b387ccb41d59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 20:51:57 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 20:51:57 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d034dc6-75d2-4951-8646-809f6c9177bb]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG os_brick.utils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:51:57 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating existing volume attachment record: 9558e3b9-082d-463e-bb7c-a9c21e01323b {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 20:52:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:52:03 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Creating image(s)
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Ensure instance console log exists: /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start _get_guest_xml network_info=[{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a559c005-897e-4c1c-bdc2-a2dce95573e9', 'attached_at': '', 'detached_at': '', 'volume_id': '9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'serial': '9c3546a8-ff4c-4cce-a64b-d9f8f8c83019'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '9558e3b9-082d-463e-bb7c-a9c21e01323b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:52:03 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:52:03 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:52:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:52:03 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:52:03 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e806e4b1-dd2f-4ce1-aa9c-869e98a90e87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 20:52:03 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de47dfa-7a1a-48fa-9c33-4b77825d2f00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019] added
Apr 13 20:52:03 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a87b82e-955d-4fbe-a4bd-70c4bd05165d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a939d05-2cbe-4c52-acb4-6d664aa9eed8]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiHTGZup {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiHTGZup" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41f04f2-4c62-4d83-9290-e311013c07b3]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aiHTGZup'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:03 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.121s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[59499420-9167-4e3c-83b5-15f0f8f0b4a2]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa73f00c-a5b6-4b2d-9c56-0cff638cfb0b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:52:04 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 13 20:52:04 user nova-compute[71285]:  {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:52:04 user nova-compute[71285]: WARNING os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 13 20:52:04 user nova-compute[71285]: 
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dae5c3-87f9-43f9-aa92-1d2fcb9b3926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260]
Apr 13 20:52:04 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260] successful.
Apr 13 20:52:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bc01cf-e8c7-429e-98e5-af4447048573]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b3abd1-7ca2-47f2-8ab1-9a1500b2b92f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 20:52:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 20:52:04 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddaed4c-a3aa-489f-9882-5e8a7b416c5a]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:52:04 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '26661366363306262', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661366363306262', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1443572831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1443572831',id=44,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-oytlioo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:51:52Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=a559c005-897e-4c1c-bdc2-a2dce95573e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:52:05 user nova-compute[71285]:   <uuid>a559c005-897e-4c1c-bdc2-a2dce95573e9</uuid>
Apr 13 20:52:05 user nova-compute[71285]:   <name>instance-0000002c</name>
Apr 13 20:52:05 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:52:05 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:52:05 user nova-compute[71285]:   <metadata>
Apr 13 20:52:05 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:52:05 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1443572831</nova:name>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:52:03</nova:creationTime>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:52:05 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:52:05 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:owner>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 20:52:05 user nova-compute[71285]:       </nova:owner>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:52:05 user nova-compute[71285]:       <nova:ports>
Apr 13 20:52:05 user nova-compute[71285]:         <nova:port uuid="ca77217a-aa63-4648-a54c-9f4d807d1acb">
Apr 13 20:52:05 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 20:52:05 user nova-compute[71285]:         </nova:port>
Apr 13 20:52:05 user nova-compute[71285]:       </nova:ports>
Apr 13 20:52:05 user nova-compute[71285]:     </nova:instance>
Apr 13 20:52:05 user nova-compute[71285]:   </metadata>
Apr 13 20:52:05 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:52:05 user nova-compute[71285]:     <system>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="serial">a559c005-897e-4c1c-bdc2-a2dce95573e9</entry>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="uuid">a559c005-897e-4c1c-bdc2-a2dce95573e9</entry>
Apr 13 20:52:05 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:52:05 user nova-compute[71285]:     </system>
Apr 13 20:52:05 user nova-compute[71285]:   </sysinfo>
Apr 13 20:52:05 user nova-compute[71285]:   <os>
Apr 13 20:52:05 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:52:05 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:52:05 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:52:05 user nova-compute[71285]:   </os>
Apr 13 20:52:05 user nova-compute[71285]:   <features>
Apr 13 20:52:05 user nova-compute[71285]:     <acpi/>
Apr 13 20:52:05 user nova-compute[71285]:     <apic/>
Apr 13 20:52:05 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:52:05 user nova-compute[71285]:   </features>
Apr 13 20:52:05 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:52:05 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:52:05 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:52:05 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:52:05 user nova-compute[71285]:   </clock>
Apr 13 20:52:05 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:52:05 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:52:05 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:52:05 user nova-compute[71285]:   </cpu>
Apr 13 20:52:05 user nova-compute[71285]:   <devices>
Apr 13 20:52:05 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:52:05 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:52:05 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:52:05 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:52:05 user nova-compute[71285]:       <serial>9c3546a8-ff4c-4cce-a64b-d9f8f8c83019</serial>
Apr 13 20:52:05 user nova-compute[71285]:     </disk>
Apr 13 20:52:05 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:52:05 user nova-compute[71285]:       <mac address="fa:16:3e:05:71:a7"/>
Apr 13 20:52:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:52:05 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:52:05 user nova-compute[71285]:       <target dev="tapca77217a-aa"/>
Apr 13 20:52:05 user nova-compute[71285]:     </interface>
Apr 13 20:52:05 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:52:05 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/console.log" append="off"/>
Apr 13 20:52:05 user nova-compute[71285]:     </serial>
Apr 13 20:52:05 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:52:05 user nova-compute[71285]:     <video>
Apr 13 20:52:05 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:52:05 user nova-compute[71285]:     </video>
Apr 13 20:52:05 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:52:05 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:52:05 user nova-compute[71285]:     </rng>
Apr 13 20:52:05 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:52:05 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:52:05 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:52:05 user nova-compute[71285]:     </memballoon>
Apr 13 20:52:05 user nova-compute[71285]:   </devices>
Apr 13 20:52:05 user nova-compute[71285]: </domain>
Apr 13 20:52:05 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1443572831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1443572831',id=44,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-oytlioo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:51:52Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=a559c005-897e-4c1c-bdc2-a2dce95573e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG os_vif [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca77217a-aa, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapca77217a-aa, col_values=(('external_ids', {'iface-id': 'ca77217a-aa63-4648-a54c-9f4d807d1acb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:71:a7', 'vm-uuid': 'a559c005-897e-4c1c-bdc2-a2dce95573e9'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:05 user nova-compute[71285]: INFO os_vif [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa')
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:52:05 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:05:71:a7, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:52:06 user nova-compute[71285]: WARNING nova.compute.manager [req-2895eb0e-8065-42d9-85b7-3b8d6f57eacb req-0579b6eb-0f96-4e38-810a-1fa09207f2ff service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state building and task_state spawning.
Apr 13 20:52:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419128.6862583, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Resumed (Lifecycle Event)
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance spawned successfully.
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419128.6895576, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Started (Lifecycle Event)
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Took 5.05 seconds to spawn the instance on the hypervisor.
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:52:08 user nova-compute[71285]: WARNING nova.compute.manager [req-ee5689ce-7a63-400a-a04e-c15099e1bf5f req-9e7185af-0d8b-4446-9c7c-e1dd2f2c56f5 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state building and task_state spawning.
Apr 13 20:52:08 user nova-compute[71285]: INFO nova.compute.manager [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Took 17.41 seconds to build instance.
Apr 13 20:52:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7ee388b7-2b6c-4bab-8428-7c48d8376a3d tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.506s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:52:10 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:52:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:52:11 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=26.285846710205078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:52:11 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:52:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:52:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:12 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:13 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:53:13 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=26.28525161743164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:53:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:53:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:53:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:53:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:53:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:42 user nova-compute[71285]: INFO nova.compute.manager [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Rescuing
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG nova.network.neutron [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:42 user nova-compute[71285]: DEBUG nova.compute.manager [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:53:42 user nova-compute[71285]: WARNING nova.compute.manager [req-383b79e5-8dfb-4c51-aa3f-bc75a44d98d4 req-d43a7b41-7a03-4702-8858-b29b14fdde25 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state active and task_state rescuing.
Apr 13 20:53:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance destroyed successfully.
Apr 13 20:53:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Attempting a stable device rescue
Apr 13 20:53:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 20:53:43 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Creating image(s)
Apr 13 20:53:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'trusted_certs' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:43 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.part --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG nova.virt.images [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 4e93d2b2-ab18-409f-a26e-e7b446406efb was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.part /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.part /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.converted" returned: 0 in 0.511s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:44 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:53:45 user nova-compute[71285]: WARNING nova.compute.manager [req-9abb4180-5eb5-4c79-8edd-e7def4f010d0 req-4259dbd1-5bee-42f0-b17d-386b30d11e2d service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state active and task_state rescuing.
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba.converted --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.618s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba,backing_fmt=raw /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba,backing_fmt=raw /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue" returned: 0 in 0.059s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "06a1b0571ff1418ea6198de3e0ea81c9dbd61fba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'migration_context' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start _get_guest_xml network_info=[{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:05:71:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4e93d2b2-ab18-409f-a26e-e7b446406efb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a559c005-897e-4c1c-bdc2-a2dce95573e9', 'attached_at': '', 'detached_at': '', 'volume_id': '9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'serial': '9c3546a8-ff4c-4cce-a64b-d9f8f8c83019'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '9558e3b9-082d-463e-bb7c-a9c21e01323b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'numa_topology' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:45 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:53:45 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'vcpu_model' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 20:53:45 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:53:45 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 20:53:45 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8c8fde-644a-4ab8-aa98-94d2d0757e4a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aiHTGZup\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 20:53:45 user nova-compute[71285]: node.name = iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019
Apr 13 20:53:45 user nova-compute[71285]: node.tpgt = -1
Apr 13 20:53:45 user nova-compute[71285]: node.startup = automatic
Apr 13 20:53:45 user nova-compute[71285]: node.leading_login = No
Apr 13 20:53:45 user nova-compute[71285]: iface.iscsi_ifacename = default
Apr 13 20:53:45 user nova-compute[71285]: iface.net_ifacename = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.ipaddress = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.prefix_len = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.hwaddress = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.transport_name = tcp
Apr 13 20:53:45 user nova-compute[71285]: iface.initiatorname = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.vlan_id = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.vlan_priority = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.vlan_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.iface_num = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.mtu = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.port = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.bootproto = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.subnet_mask = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.gateway = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_alt_client_id = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_dns = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_learn_iqn = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_vendor_id_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_vendor_id = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.dhcp_slp_da = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.fragmentation = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.gratuitous_arp = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.incoming_forwarding = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.tos_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.tos = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.ttl = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.delayed_ack = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.tcp_nagle = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.tcp_wsf_state = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.tcp_wsf = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.tcp_timer_scale = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.tcp_timestamp = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.redirect = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.def_task_mgmt_timeout = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.header_digest = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.data_digest = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.immediate_data = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.initial_r2t = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.data_seq_inorder = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.data_pdu_inorder = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.erl = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.max_receive_data_len = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.first_burst_len = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.max_outstanding_r2t = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.max_burst_len = 0
Apr 13 20:53:45 user nova-compute[71285]: iface.chap_auth = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.bidi_chap = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.strict_login_compliance = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.discovery_auth = <empty>
Apr 13 20:53:45 user nova-compute[71285]: iface.discovery_logout = <empty>
Apr 13 20:53:45 user nova-compute[71285]: node.discovery_address = <empty>
Apr 13 20:53:45 user nova-compute[71285]: node.discovery_port = 0
Apr 13 20:53:45 user nova-compute[71285]: node.discovery_type = static
Apr 13 20:53:45 user nova-compute[71285]: node.session.initial_cmdsn = 0
Apr 13 20:53:45 user nova-compute[71285]: node.session.initial_login_retry_max = 8
Apr 13 20:53:45 user nova-compute[71285]: node.session.xmit_thread_priority = -20
Apr 13 20:53:45 user nova-compute[71285]: node.session.cmds_max = 128
Apr 13 20:53:45 user nova-compute[71285]: node.session.queue_depth = 32
Apr 13 20:53:45 user nova-compute[71285]: node.session.nr_sessions = 1
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.authmethod = CHAP
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.username = aiHTGZup
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.password = ***
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.username_in = <empty>
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.password_in = <empty>
Apr 13 20:53:45 user nova-compute[71285]: node.session.auth.chap_algs = MD5
Apr 13 20:53:45 user nova-compute[71285]: node.session.timeo.replacement_timeout = 120
Apr 13 20:53:45 user nova-compute[71285]: node.session.err_timeo.abort_timeout = 15
Apr 13 20:53:45 user nova-compute[71285]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 20:53:45 user nova-compute[71285]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 20:53:45 user nova-compute[71285]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.FastAbort = Yes
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.InitialR2T = No
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.ImmediateData = Yes
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.MaxConnections = 1
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 20:53:45 user nova-compute[71285]: node.session.iscsi.ERL = 0
Apr 13 20:53:45 user nova-compute[71285]: node.session.scan = manual
Apr 13 20:53:45 user nova-compute[71285]: node.session.reopen_max = 0
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].address = 172.16.0.220
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].port = 3260
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].startup = manual
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].tcp.window_size = 524288
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].tcp.type_of_service = 0
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].timeo.logout_timeout = 15
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].timeo.login_timeout = 15
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].timeo.auth_timeout = 45
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.DataDigest = None
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.IFMarker = No
Apr 13 20:53:45 user nova-compute[71285]: node.conn[0].iscsi.OFMarker = No
Apr 13 20:53:45 user nova-compute[71285]: # END RECORD
Apr 13 20:53:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[05651823-8e9c-44a2-82f6-624ed15d8834]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fa04c7-7630-4000-9bdc-b7706f95ba32]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiHTGZup {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aiHTGZup" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db002d0-d5b6-4412-a4df-fbcb678ad28e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aiHTGZup'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed86f0b-d876-4df3-9af6-4d18b382115c]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a2a867-599d-4b17-819f-5516f45a1c21]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 20:53:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 20:53:45 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HCTL ('33', '0', '0', 0) found on session 53 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5b3af2-7cab-46c1-b51b-0b40f0420806]: (4, ('0 0 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Searching for a device in session 53 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '26661366363306262', 'path': '/dev/sdb'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661366363306262', 'path': '/dev/sdb'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1443572831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1443572831',id=44,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:52:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-oytlioo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:52:09Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=a559c005-897e-4c1c-bdc2-a2dce95573e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:05:71:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:05:71:a7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:53:45 user nova-compute[71285]:   <uuid>a559c005-897e-4c1c-bdc2-a2dce95573e9</uuid>
Apr 13 20:53:45 user nova-compute[71285]:   <name>instance-0000002c</name>
Apr 13 20:53:45 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:53:45 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:53:45 user nova-compute[71285]:   <metadata>
Apr 13 20:53:45 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:53:45 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1443572831</nova:name>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:53:45</nova:creationTime>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:53:45 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:53:45 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:owner>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 20:53:45 user nova-compute[71285]:       </nova:owner>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:53:45 user nova-compute[71285]:       <nova:ports>
Apr 13 20:53:45 user nova-compute[71285]:         <nova:port uuid="ca77217a-aa63-4648-a54c-9f4d807d1acb">
Apr 13 20:53:45 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 13 20:53:45 user nova-compute[71285]:         </nova:port>
Apr 13 20:53:45 user nova-compute[71285]:       </nova:ports>
Apr 13 20:53:45 user nova-compute[71285]:     </nova:instance>
Apr 13 20:53:45 user nova-compute[71285]:   </metadata>
Apr 13 20:53:45 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:53:45 user nova-compute[71285]:     <system>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="serial">a559c005-897e-4c1c-bdc2-a2dce95573e9</entry>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="uuid">a559c005-897e-4c1c-bdc2-a2dce95573e9</entry>
Apr 13 20:53:45 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:53:45 user nova-compute[71285]:     </system>
Apr 13 20:53:45 user nova-compute[71285]:   </sysinfo>
Apr 13 20:53:45 user nova-compute[71285]:   <os>
Apr 13 20:53:45 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:53:45 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:53:45 user nova-compute[71285]:   </os>
Apr 13 20:53:45 user nova-compute[71285]:   <features>
Apr 13 20:53:45 user nova-compute[71285]:     <acpi/>
Apr 13 20:53:45 user nova-compute[71285]:     <apic/>
Apr 13 20:53:45 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:53:45 user nova-compute[71285]:   </features>
Apr 13 20:53:45 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:53:45 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:53:45 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:53:45 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:53:45 user nova-compute[71285]:   </clock>
Apr 13 20:53:45 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:53:45 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:53:45 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:53:45 user nova-compute[71285]:   </cpu>
Apr 13 20:53:45 user nova-compute[71285]:   <devices>
Apr 13 20:53:45 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 20:53:45 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 20:53:45 user nova-compute[71285]:       <source dev="/dev/sdb"/>
Apr 13 20:53:45 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:53:45 user nova-compute[71285]:       <serial>9c3546a8-ff4c-4cce-a64b-d9f8f8c83019</serial>
Apr 13 20:53:45 user nova-compute[71285]:     </disk>
Apr 13 20:53:45 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:53:45 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:53:45 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue"/>
Apr 13 20:53:45 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 20:53:45 user nova-compute[71285]:       <boot order="1"/>
Apr 13 20:53:45 user nova-compute[71285]:     </disk>
Apr 13 20:53:45 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:53:45 user nova-compute[71285]:       <mac address="fa:16:3e:05:71:a7"/>
Apr 13 20:53:45 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:53:45 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:53:45 user nova-compute[71285]:       <target dev="tapca77217a-aa"/>
Apr 13 20:53:45 user nova-compute[71285]:     </interface>
Apr 13 20:53:45 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:53:45 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/console.log" append="off"/>
Apr 13 20:53:45 user nova-compute[71285]:     </serial>
Apr 13 20:53:45 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:53:45 user nova-compute[71285]:     <video>
Apr 13 20:53:45 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:53:45 user nova-compute[71285]:     </video>
Apr 13 20:53:45 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:53:45 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:53:45 user nova-compute[71285]:     </rng>
Apr 13 20:53:45 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:53:45 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:53:45 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:53:45 user nova-compute[71285]:     </memballoon>
Apr 13 20:53:45 user nova-compute[71285]:   </devices>
Apr 13 20:53:45 user nova-compute[71285]: </domain>
Apr 13 20:53:45 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:53:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance destroyed successfully.
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:53:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:05:71:a7, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:53:47 user nova-compute[71285]: WARNING nova.compute.manager [req-69442450-b480-4b89-93b6-a81863cdd2d8 req-1b89945b-6675-48bb-89ac-e31925ad50fc service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state active and task_state rescuing.
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for a559c005-897e-4c1c-bdc2-a2dce95573e9 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419229.1280866, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:53:49 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Resumed (Lifecycle Event)
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-a764fab9-3000-41f5-b341-64107110bec3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:53:49 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419229.1309164, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:53:49 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Started (Lifecycle Event)
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:53:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:53:49 user nova-compute[71285]: WARNING nova.compute.manager [req-5d464ba8-c719-4f52-a343-21f1422998da req-84f8ed9f-1658-49c1-a204-a01ecb2b1fb6 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state rescued and task_state None.
Apr 13 20:53:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:53:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:54:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:54:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8677MB free_disk=26.206153869628906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:54:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.238s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:54:16 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Verify base images {{(pid=71285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Image id 89a0e641-f418-4fdd-8f20-480666e0188c yields fingerprint e8edcb70ec54e8d499649ccc13333ab079fbd8b2 {{(pid=71285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] image 89a0e641-f418-4fdd-8f20-480666e0188c at (/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2): checking
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] image 89a0e641-f418-4fdd-8f20-480666e0188c at (/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2): image is in use {{(pid=71285) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] a559c005-897e-4c1c-bdc2-a2dce95573e9 is a valid instance name {{(pid=71285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 is a valid instance name {{(pid=71285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 has a disk file {{(pid=71285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 is backed by e8edcb70ec54e8d499649ccc13333ab079fbd8b2 {{(pid=71285) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba
Apr 13 20:54:36 user nova-compute[71285]: WARNING nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Active base files: /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Removable base files: /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065 /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3 /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469 /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87 /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9 /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3c148e9b5b7ca5037c016fa22690e5b0983407c
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2a43200de496bbb7b935a839c0c5d58065bb1065
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3431100a5153f0576f6fe6945f1b566296176e3
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba8a5d3ce3b0db6dc00473b926459bbfdf4a7469
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0424c0966d7a74b9e75f9ea2f543f076317deb87
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c9287fd5f4e117b56ba12629b13601261cc94cf9
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/06a1b0571ff1418ea6198de3e0ea81c9dbd61fba
Apr 13 20:54:36 user nova-compute[71285]: INFO nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4a7cc193193e7d73f5a0f1479006918609ae7e9
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Verification complete {{(pid=71285) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Verify swap images {{(pid=71285) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 13 20:54:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.imagecache [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Verify ephemeral images {{(pid=71285) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:54:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:54:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:06 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:15 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:55:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:55:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:55:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=26.205459594726562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:55:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 20:55:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:55:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:32 user nova-compute[71285]: INFO nova.compute.manager [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Unrescuing
Apr 13 20:55:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:55:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:55:32 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.network.neutron [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.objects.instance [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'flavor' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:33 user nova-compute[71285]: INFO nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG nova.compute.manager [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:55:33 user nova-compute[71285]: WARNING nova.compute.manager [req-945de578-b18f-42cc-ba5c-b6815fdea6ae req-95e9553f-088f-4fe0-99f1-bfc750f1c0c0 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:55:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:34 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:34 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance destroyed successfully.
Apr 13 20:55:34 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:55:35 user nova-compute[71285]: WARNING nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:55:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:35 user nova-compute[71285]: DEBUG nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:55:35 user nova-compute[71285]: WARNING nova.compute.manager [req-5a365bde-ca45-44e0-9946-d4819b3fd2ab req-1f4a3f46-b8fc-4a3a-857c-92b2ad4aa097 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state rescued and task_state unrescuing.
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for a559c005-897e-4c1c-bdc2-a2dce95573e9 due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419337.7067528, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:55:37 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Resumed (Lifecycle Event)
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-0fff547a-a138-4fe8-a1f0-301ee0a7acaa tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:55:37 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419337.7101605, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:55:37 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Started (Lifecycle Event)
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:55:37 user nova-compute[71285]: DEBUG nova.compute.manager [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:55:37 user nova-compute[71285]: WARNING nova.compute.manager [req-252d9d78-daa1-41f1-9cb4-46fbb4417134 req-34d97a87-1de5-479e-99ea-b51abf2fe785 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state active and task_state None.
Apr 13 20:55:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:55:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:55:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:07 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:56:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:56:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:56:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:56:17 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=26.20528793334961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:56:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:56:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:56:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:56:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:56:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:56:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:57:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:08 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:57:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:19 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:57:19 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=26.204708099365234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:57:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:24 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 20:57:24 user nova-compute[71285]: INFO nova.compute.claims [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Claim successful on node user
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 20:57:25 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.policy [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 20:57:25 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Creating image(s)
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.194s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk 1073741824" returned: 0 in 0.046s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Successfully created port: 58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Cannot resize image /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'migration_context' on Instance uuid ec312720-9493-463e-96b6-2e659ac966b2 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Ensure instance console log exists: /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Successfully updated port: 58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-changed-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Refreshing instance network info cache due to event network-changed-58154f44-c606-4862-a417-27ec125c2d26. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Acquiring lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.neutron [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Instance network_info: |[{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Acquired lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Refreshing network info cache for port 58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Start _get_guest_xml network_info=[{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 20:57:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:57:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1875948222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1875948222',id=45,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ehs8o4dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:57:25Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=ec312720-9493-463e-96b6-2e659ac966b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.objects.instance [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid ec312720-9493-463e-96b6-2e659ac966b2 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] End _get_guest_xml xml=<domain type="kvm">
Apr 13 20:57:26 user nova-compute[71285]:   <uuid>ec312720-9493-463e-96b6-2e659ac966b2</uuid>
Apr 13 20:57:26 user nova-compute[71285]:   <name>instance-0000002d</name>
Apr 13 20:57:26 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 20:57:26 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 20:57:26 user nova-compute[71285]:   <metadata>
Apr 13 20:57:26 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 20:57:26 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1875948222</nova:name>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:creationTime>2023-04-13 20:57:26</nova:creationTime>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 20:57:26 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 20:57:26 user nova-compute[71285]:       </nova:flavor>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:owner>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 20:57:26 user nova-compute[71285]:       </nova:owner>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 20:57:26 user nova-compute[71285]:       <nova:ports>
Apr 13 20:57:26 user nova-compute[71285]:         <nova:port uuid="58154f44-c606-4862-a417-27ec125c2d26">
Apr 13 20:57:26 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 13 20:57:26 user nova-compute[71285]:         </nova:port>
Apr 13 20:57:26 user nova-compute[71285]:       </nova:ports>
Apr 13 20:57:26 user nova-compute[71285]:     </nova:instance>
Apr 13 20:57:26 user nova-compute[71285]:   </metadata>
Apr 13 20:57:26 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 20:57:26 user nova-compute[71285]:     <system>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="serial">ec312720-9493-463e-96b6-2e659ac966b2</entry>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="uuid">ec312720-9493-463e-96b6-2e659ac966b2</entry>
Apr 13 20:57:26 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 20:57:26 user nova-compute[71285]:     </system>
Apr 13 20:57:26 user nova-compute[71285]:   </sysinfo>
Apr 13 20:57:26 user nova-compute[71285]:   <os>
Apr 13 20:57:26 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 20:57:26 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 20:57:26 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 20:57:26 user nova-compute[71285]:   </os>
Apr 13 20:57:26 user nova-compute[71285]:   <features>
Apr 13 20:57:26 user nova-compute[71285]:     <acpi/>
Apr 13 20:57:26 user nova-compute[71285]:     <apic/>
Apr 13 20:57:26 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 20:57:26 user nova-compute[71285]:   </features>
Apr 13 20:57:26 user nova-compute[71285]:   <clock offset="utc">
Apr 13 20:57:26 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 20:57:26 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 20:57:26 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 20:57:26 user nova-compute[71285]:   </clock>
Apr 13 20:57:26 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 20:57:26 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 20:57:26 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 20:57:26 user nova-compute[71285]:   </cpu>
Apr 13 20:57:26 user nova-compute[71285]:   <devices>
Apr 13 20:57:26 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 20:57:26 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 20:57:26 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk"/>
Apr 13 20:57:26 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 20:57:26 user nova-compute[71285]:     </disk>
Apr 13 20:57:26 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 20:57:26 user nova-compute[71285]:       <mac address="fa:16:3e:e8:ec:0d"/>
Apr 13 20:57:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:57:26 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 20:57:26 user nova-compute[71285]:       <target dev="tap58154f44-c6"/>
Apr 13 20:57:26 user nova-compute[71285]:     </interface>
Apr 13 20:57:26 user nova-compute[71285]:     <serial type="pty">
Apr 13 20:57:26 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/console.log" append="off"/>
Apr 13 20:57:26 user nova-compute[71285]:     </serial>
Apr 13 20:57:26 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 20:57:26 user nova-compute[71285]:     <video>
Apr 13 20:57:26 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 20:57:26 user nova-compute[71285]:     </video>
Apr 13 20:57:26 user nova-compute[71285]:     <rng model="virtio">
Apr 13 20:57:26 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 20:57:26 user nova-compute[71285]:     </rng>
Apr 13 20:57:26 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 20:57:26 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 20:57:26 user nova-compute[71285]:       <stats period="10"/>
Apr 13 20:57:26 user nova-compute[71285]:     </memballoon>
Apr 13 20:57:26 user nova-compute[71285]:   </devices>
Apr 13 20:57:26 user nova-compute[71285]: </domain>
Apr 13 20:57:26 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1875948222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1875948222',id=45,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ehs8o4dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T20:57:25Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=ec312720-9493-463e-96b6-2e659ac966b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG os_vif [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58154f44-c6, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap58154f44-c6, col_values=(('external_ids', {'iface-id': '58154f44-c606-4862-a417-27ec125c2d26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ec:0d', 'vm-uuid': 'ec312720-9493-463e-96b6-2e659ac966b2'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 20:57:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:27 user nova-compute[71285]: INFO os_vif [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6')
Apr 13 20:57:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:e8:ec:0d, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG nova.network.neutron [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updated VIF entry in instance network info cache for port 58154f44-c606-4862-a417-27ec125c2d26. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG nova.network.neutron [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-05bf7b8d-7956-433b-a087-98a0c2de5454 req-dbbd90c0-6182-4b58-8281-5e1f9ca7b418 service nova] Releasing lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:57:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:28 user nova-compute[71285]: DEBUG nova.compute.manager [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] No waiting events found dispatching network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:57:28 user nova-compute[71285]: WARNING nova.compute.manager [req-2abdf258-c6bc-4f80-bfa2-8145901b6893 req-01a4c8ea-9a00-4a2a-9f83-011b3f1bb2ce service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received unexpected event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 for instance with vm_state building and task_state spawning.
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419450.4002256, ec312720-9493-463e-96b6-2e659ac966b2 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] VM Resumed (Lifecycle Event)
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Instance spawned successfully.
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419450.405003, ec312720-9493-463e-96b6-2e659ac966b2 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] VM Started (Lifecycle Event)
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Took 5.25 seconds to spawn the instance on the hypervisor.
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:30 user nova-compute[71285]: DEBUG nova.compute.manager [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] No waiting events found dispatching network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 20:57:30 user nova-compute[71285]: WARNING nova.compute.manager [req-75464978-7b73-404d-90cf-5f076cb6c667 req-d7bb1c99-ddf3-4c56-ae79-c1d7e1eb09bb service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received unexpected event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 for instance with vm_state active and task_state None.
Apr 13 20:57:30 user nova-compute[71285]: INFO nova.compute.manager [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Took 5.79 seconds to build instance.
Apr 13 20:57:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-ea9694bf-6a87-4b91-b732-59528621c4c5 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.878s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:57:31 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:57:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:57:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:09 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:58:17 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:58:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:58:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:58:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=26.183334350585938GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:58:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:58:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:58:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:58:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:58:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:58:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:58:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:59:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:10 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:15 user nova-compute[71285]: DEBUG nova.compute.manager [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 20:59:15 user nova-compute[71285]: INFO nova.compute.manager [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] instance snapshotting
Apr 13 20:59:15 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Beginning live snapshot process
Apr 13 20:59:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json -f qcow2 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1.delta 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1.delta 1073741824" returned: 0 in 0.050s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 13 20:59:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:59:17 user nova-compute[71285]: DEBUG nova.virt.libvirt.guest [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71285) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 13 20:59:17 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 13 20:59:17 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 20:59:17 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1.delta /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:18 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1.delta /opt/stack/data/nova/instances/snapshots/tmp_ox4xou0/61e65cd0412a4ad9b45f21aa2e4d3ba1" returned: 0 in 0.473s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:18 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Snapshot extracted, beginning image upload
Apr 13 20:59:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 20:59:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 20:59:20 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Snapshot image upload complete
Apr 13 20:59:20 user nova-compute[71285]: INFO nova.compute.manager [None req-04ed23d6-4a2b-415e-b62b-bbd4c5f1c9c3 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Took 4.52 seconds to snapshot the instance on the hypervisor.
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:20 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 20:59:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:59:21 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=26.146595001220703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 20:59:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 20:59:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:59:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 20:59:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:59:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 20:59:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 20:59:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 20:59:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:12 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:00:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:00:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:00:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:00:22 user nova-compute[71285]: INFO nova.compute.claims [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Claim successful on node user
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:22 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:00:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:00:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=26.14588165283203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.769s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.118s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:00:23 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:00:23 user nova-compute[71285]: INFO nova.virt.block_device [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Booting with volume-backed-image 89a0e641-f418-4fdd-8f20-480666e0188c at /dev/vda
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.policy [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce4e20ca99b8451c9087c565778ab88f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9873771332b48b78929463707ce74d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Successfully created port: 16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Successfully updated port: 16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:00:24 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-changed-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.compute.manager [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Refreshing instance network info cache due to event network-changed-16c9b002-957a-4236-9d73-299ca369d311. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Acquiring lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance network_info: |[{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Acquired lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:00:25 user nova-compute[71285]: DEBUG nova.network.neutron [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Refreshing network info cache for port 16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:00:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updated VIF entry in instance network info cache for port 16c9b002-957a-4236-9d73-299ca369d311. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:00:26 user nova-compute[71285]: DEBUG nova.network.neutron [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:00:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9f6c51a3-ad6f-4106-80b2-4eb5c33b1f4c req-69c8e080-6e46-447d-af0e-f66955780677 service nova] Releasing lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:00:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.utils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[345530e1-06fc-4232-8454-88a804337343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b956dd6f73ca\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d7b221-383c-4661-b88c-c7feb16479fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d28cc1-f25a-41df-bff5-de37cba3077a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de57be3-17d3-42ef-98c0-b8a137c27aaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): nvme version {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] 'nvme version' failed. Not Retrying. {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] nvme not present on system {{(pid=71285) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 13 21:00:29 user nova-compute[71285]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 13 21:00:29 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[919f7180-f405-4ebd-a345-57d5c444b83c]: (4, '') {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71285) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.lightos [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] LIGHTOS: no hostnqn found. {{(pid=71285) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG os_brick.utils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b956dd6f73ca', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:00:29 user nova-compute[71285]: DEBUG nova.virt.block_device [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating existing volume attachment record: e7146d25-3f74-423c-b22f-0ff2b8eba048 {{(pid=71285) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 13 21:00:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:30 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:00:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:32 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:00:33 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Creating image(s)
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Did not create local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Ensure instance console log exists: /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start _get_guest_xml network_info=[{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02be72c4-1b93-4639-86f2-05570a6366fe', 'attached_at': '', 'detached_at': '', 'volume_id': '0d87e363-af15-4053-bd86-dbbea6677351', 'serial': '0d87e363-af15-4053-bd86-dbbea6677351'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'e7146d25-3f74-423c-b22f-0ff2b8eba048', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:00:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:00:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:00:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:00:33 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:00:33 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea58cee-2708-441d-ac3f-3ef98efdb74c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 13 21:00:33 user nova-compute[71285]:  {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:33 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --interface default --op new {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e96eee-7dfd-44ec-9f6b-2b1d480bc081]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351] added\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351] added
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b283454-ea48-40d9-a013-3ccc434f4959]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9187072-f4ec-4f7b-8a84-eb5a7cc558b9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odDPvKNc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odDPvKNc" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[330dd78f-26a5-415b-bb69-ab4bf5ec036a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odDPvKNc'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a36e12e-6eb3-4d3a-9180-139763f9a903]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb20e969-69bf-4acc-bcf2-0f1d23922d9b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --login {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9012a51b-9e05-41a5-911e-670c6ad03d52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260]
Apr 13 21:00:34 user nova-compute[71285]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260] successful.
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f01a5-fe8e-45cf-928e-a116a6477fb0]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[77840465-e19e-46a5-b7e5-e14ac4357bff]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:00:34 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed41be0-a9fa-465b-82f4-380d6cf7107c]: (4, ('- - 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:00:34 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23833366238366337', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833366238366337', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-646592594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-646592594',id=46,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-0avuc9pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:00:23Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=02be72c4-1b93-4639-86f2-05570a6366fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.objects.instance [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:00:35 user nova-compute[71285]:   <uuid>02be72c4-1b93-4639-86f2-05570a6366fe</uuid>
Apr 13 21:00:35 user nova-compute[71285]:   <name>instance-0000002e</name>
Apr 13 21:00:35 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 21:00:35 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 21:00:35 user nova-compute[71285]:   <metadata>
Apr 13 21:00:35 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:00:35 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-646592594</nova:name>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:creationTime>2023-04-13 21:00:33</nova:creationTime>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 21:00:35 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:00:35 user nova-compute[71285]:       </nova:flavor>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:owner>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 21:00:35 user nova-compute[71285]:       </nova:owner>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 21:00:35 user nova-compute[71285]:       <nova:ports>
Apr 13 21:00:35 user nova-compute[71285]:         <nova:port uuid="16c9b002-957a-4236-9d73-299ca369d311">
Apr 13 21:00:35 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:00:35 user nova-compute[71285]:         </nova:port>
Apr 13 21:00:35 user nova-compute[71285]:       </nova:ports>
Apr 13 21:00:35 user nova-compute[71285]:     </nova:instance>
Apr 13 21:00:35 user nova-compute[71285]:   </metadata>
Apr 13 21:00:35 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 21:00:35 user nova-compute[71285]:     <system>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="serial">02be72c4-1b93-4639-86f2-05570a6366fe</entry>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="uuid">02be72c4-1b93-4639-86f2-05570a6366fe</entry>
Apr 13 21:00:35 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:00:35 user nova-compute[71285]:     </system>
Apr 13 21:00:35 user nova-compute[71285]:   </sysinfo>
Apr 13 21:00:35 user nova-compute[71285]:   <os>
Apr 13 21:00:35 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:00:35 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 21:00:35 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 21:00:35 user nova-compute[71285]:   </os>
Apr 13 21:00:35 user nova-compute[71285]:   <features>
Apr 13 21:00:35 user nova-compute[71285]:     <acpi/>
Apr 13 21:00:35 user nova-compute[71285]:     <apic/>
Apr 13 21:00:35 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 21:00:35 user nova-compute[71285]:   </features>
Apr 13 21:00:35 user nova-compute[71285]:   <clock offset="utc">
Apr 13 21:00:35 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:00:35 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:00:35 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 21:00:35 user nova-compute[71285]:   </clock>
Apr 13 21:00:35 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 21:00:35 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 21:00:35 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:00:35 user nova-compute[71285]:   </cpu>
Apr 13 21:00:35 user nova-compute[71285]:   <devices>
Apr 13 21:00:35 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 21:00:35 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:00:35 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 21:00:35 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 21:00:35 user nova-compute[71285]:       <serial>0d87e363-af15-4053-bd86-dbbea6677351</serial>
Apr 13 21:00:35 user nova-compute[71285]:     </disk>
Apr 13 21:00:35 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 21:00:35 user nova-compute[71285]:       <mac address="fa:16:3e:f1:99:a3"/>
Apr 13 21:00:35 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:00:35 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 21:00:35 user nova-compute[71285]:       <target dev="tap16c9b002-95"/>
Apr 13 21:00:35 user nova-compute[71285]:     </interface>
Apr 13 21:00:35 user nova-compute[71285]:     <serial type="pty">
Apr 13 21:00:35 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/console.log" append="off"/>
Apr 13 21:00:35 user nova-compute[71285]:     </serial>
Apr 13 21:00:35 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:00:35 user nova-compute[71285]:     <video>
Apr 13 21:00:35 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:00:35 user nova-compute[71285]:     </video>
Apr 13 21:00:35 user nova-compute[71285]:     <rng model="virtio">
Apr 13 21:00:35 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:00:35 user nova-compute[71285]:     </rng>
Apr 13 21:00:35 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:00:35 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 21:00:35 user nova-compute[71285]:       <stats period="10"/>
Apr 13 21:00:35 user nova-compute[71285]:     </memballoon>
Apr 13 21:00:35 user nova-compute[71285]:   </devices>
Apr 13 21:00:35 user nova-compute[71285]: </domain>
Apr 13 21:00:35 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-646592594',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-646592594',id=46,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-0avuc9pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:00:23Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=02be72c4-1b93-4639-86f2-05570a6366fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG os_vif [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16c9b002-95, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap16c9b002-95, col_values=(('external_ids', {'iface-id': '16c9b002-957a-4236-9d73-299ca369d311', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:99:a3', 'vm-uuid': '02be72c4-1b93-4639-86f2-05570a6366fe'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:35 user nova-compute[71285]: INFO os_vif [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95')
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:00:35 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:f1:99:a3, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:00:36 user nova-compute[71285]: WARNING nova.compute.manager [req-9e809f6b-711b-47b5-ae24-a23360b23d57 req-38421999-1344-40cd-9470-1d45555970cb service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state building and task_state spawning.
Apr 13 21:00:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419638.7511606, 02be72c4-1b93-4639-86f2-05570a6366fe => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Resumed (Lifecycle Event)
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance spawned successfully.
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419638.7519069, 02be72c4-1b93-4639-86f2-05570a6366fe => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Started (Lifecycle Event)
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:00:38 user nova-compute[71285]: WARNING nova.compute.manager [req-30fe3fed-8d46-4c47-8d2a-381ca55eaabc req-1f16559c-6367-4fdc-90d6-9accdbaafda0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state building and task_state spawning.
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 13 21:00:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:00:38 user nova-compute[71285]: INFO nova.compute.manager [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Took 16.57 seconds to build instance.
Apr 13 21:00:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-58116461-d665-4551-b269-c94fbdce8e41 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.669s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:00:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:00:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:00:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:13 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:01:21 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:01:22 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:01:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:01:23 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8636MB free_disk=26.1441650390625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:01:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:01:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:31 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:01:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:01:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:01:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:01:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:12 user nova-compute[71285]: INFO nova.compute.manager [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Rescuing
Apr 13 21:02:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:02:12 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:02:12 user nova-compute[71285]: DEBUG nova.network.neutron [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG nova.network.neutron [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG nova.compute.manager [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:02:13 user nova-compute[71285]: WARNING nova.compute.manager [req-ba4c793d-58a4-42f1-91b0-92ad3deb19b1 req-f0ed21a0-bd40-4ccf-9947-490dee931c69 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state active and task_state rescuing.
Apr 13 21:02:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance destroyed successfully.
Apr 13 21:02:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Attempting a stable device rescue
Apr 13 21:02:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71285) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance directory exists: not creating {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 13 21:02:14 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Creating image(s)
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'trusted_certs' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:14 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.part --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.part --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.images [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] b424b145-85f8-4e10-be14-bd32fe2f4582 was qcow2, converting to raw {{(pid=71285) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.privsep.utils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71285) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.part /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.converted {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.part /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.converted" returned: 0 in 0.359s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.converted --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7.converted --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.365s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7 --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7,backing_fmt=raw /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.compute.manager [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:02:15 user nova-compute[71285]: WARNING nova.compute.manager [req-fa84c8ab-c399-4aae-ae55-2abeaa930c8d req-54d94801-3b7a-4e2f-b15b-a0100784a1e6 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state active and task_state rescuing.
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7,backing_fmt=raw /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue" returned: 0 in 0.055s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "4d34e4db9e89d500a44a3bd6d04bc12e806fcbc7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'migration_context' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start _get_guest_xml network_info=[{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:f1:99:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b424b145-85f8-4e10-be14-bd32fe2f4582', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '02be72c4-1b93-4639-86f2-05570a6366fe', 'attached_at': '', 'detached_at': '', 'volume_id': '0d87e363-af15-4053-bd86-dbbea6677351', 'serial': '0d87e363-af15-4053-bd86-dbbea6677351'}, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'e7146d25-3f74-423c-b22f-0ff2b8eba048', 'delete_on_termination': False, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'numa_topology' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:02:15 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'vcpu_model' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Calling os-brick to attach iSCSI Volume {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:02:15 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:02:15 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:02:15 user nova-compute[71285]: INFO os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb10adb4-e3d5-4acb-bea8-dd3502a2e5a5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = odDPvKNc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 13 21:02:15 user nova-compute[71285]: node.name = iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351
Apr 13 21:02:15 user nova-compute[71285]: node.tpgt = -1
Apr 13 21:02:15 user nova-compute[71285]: node.startup = automatic
Apr 13 21:02:15 user nova-compute[71285]: node.leading_login = No
Apr 13 21:02:15 user nova-compute[71285]: iface.iscsi_ifacename = default
Apr 13 21:02:15 user nova-compute[71285]: iface.net_ifacename = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.ipaddress = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.prefix_len = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.hwaddress = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.transport_name = tcp
Apr 13 21:02:15 user nova-compute[71285]: iface.initiatorname = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.vlan_id = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.vlan_priority = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.vlan_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.iface_num = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.mtu = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.port = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.bootproto = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.subnet_mask = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.gateway = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_alt_client_id_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_alt_client_id = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_dns = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_learn_iqn = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_req_vendor_id_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_vendor_id_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_vendor_id = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.dhcp_slp_da = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.fragmentation = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.gratuitous_arp = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.incoming_forwarding = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.tos_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.tos = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.ttl = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.delayed_ack = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.tcp_nagle = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.tcp_wsf_state = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.tcp_wsf = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.tcp_timer_scale = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.tcp_timestamp = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.redirect = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.def_task_mgmt_timeout = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.header_digest = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.data_digest = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.immediate_data = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.initial_r2t = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.data_seq_inorder = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.data_pdu_inorder = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.erl = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.max_receive_data_len = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.first_burst_len = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.max_outstanding_r2t = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.max_burst_len = 0
Apr 13 21:02:15 user nova-compute[71285]: iface.chap_auth = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.bidi_chap = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.strict_login_compliance = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.discovery_auth = <empty>
Apr 13 21:02:15 user nova-compute[71285]: iface.discovery_logout = <empty>
Apr 13 21:02:15 user nova-compute[71285]: node.discovery_address = <empty>
Apr 13 21:02:15 user nova-compute[71285]: node.discovery_port = 0
Apr 13 21:02:15 user nova-compute[71285]: node.discovery_type = static
Apr 13 21:02:15 user nova-compute[71285]: node.session.initial_cmdsn = 0
Apr 13 21:02:15 user nova-compute[71285]: node.session.initial_login_retry_max = 8
Apr 13 21:02:15 user nova-compute[71285]: node.session.xmit_thread_priority = -20
Apr 13 21:02:15 user nova-compute[71285]: node.session.cmds_max = 128
Apr 13 21:02:15 user nova-compute[71285]: node.session.queue_depth = 32
Apr 13 21:02:15 user nova-compute[71285]: node.session.nr_sessions = 1
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.authmethod = CHAP
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.username = odDPvKNc
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.password = ***
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.username_in = <empty>
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.password_in = <empty>
Apr 13 21:02:15 user nova-compute[71285]: node.session.auth.chap_algs = MD5
Apr 13 21:02:15 user nova-compute[71285]: node.session.timeo.replacement_timeout = 120
Apr 13 21:02:15 user nova-compute[71285]: node.session.err_timeo.abort_timeout = 15
Apr 13 21:02:15 user nova-compute[71285]: node.session.err_timeo.lu_reset_timeout = 30
Apr 13 21:02:15 user nova-compute[71285]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 13 21:02:15 user nova-compute[71285]: node.session.err_timeo.host_reset_timeout = 60
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.FastAbort = Yes
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.InitialR2T = No
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.ImmediateData = Yes
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.FirstBurstLength = 262144
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.MaxBurstLength = 16776192
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.DefaultTime2Retain = 0
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.DefaultTime2Wait = 2
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.MaxConnections = 1
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 13 21:02:15 user nova-compute[71285]: node.session.iscsi.ERL = 0
Apr 13 21:02:15 user nova-compute[71285]: node.session.scan = manual
Apr 13 21:02:15 user nova-compute[71285]: node.session.reopen_max = 0
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].address = 172.16.0.220
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].port = 3260
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].startup = manual
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].tcp.window_size = 524288
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].tcp.type_of_service = 0
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].timeo.logout_timeout = 15
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].timeo.login_timeout = 15
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].timeo.auth_timeout = 45
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].timeo.noop_out_interval = 5
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].timeo.noop_out_timeout = 5
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.HeaderDigest = None
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.DataDigest = None
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.IFMarker = No
Apr 13 21:02:15 user nova-compute[71285]: node.conn[0].iscsi.OFMarker = No
Apr 13 21:02:15 user nova-compute[71285]: # END RECORD
Apr 13 21:02:15 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd80b989-d624-4d42-a2bc-80863f24c759]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:02:15 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a9f2ba-aeaf-4721-bf6e-ea12ecc53940]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odDPvKNc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odDPvKNc" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08d605-4dc8-4cd6-b5af-ea15c51b5067]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odDPvKNc'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ecd6b-ca23-4399-b896-99a4c54c223d]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[9323391e-c846-4c50-bbb0-40e66803b8c4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:02:16 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:02:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:02:16 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:02:16 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to 172.16.0.220:3260 {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] HCTL ('34', '0', '0', 0) found on session 54 with lun 0 {{(pid=71285) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71285) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3e4eb1-46dd-4ee1-817d-45a92bbf3557]: (4, ('0 0 0', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Searching for a device in session 54 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71285) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71285) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== connect_volume: return (158ms) {'type': 'block', 'scsi_wwn': '23833366238366337', 'path': '/dev/sdc'} {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833366238366337', 'path': '/dev/sdc'} {{(pid=71285) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-646592594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-646592594',id=46,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-0avuc9pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:00:39Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=02be72c4-1b93-4639-86f2-05570a6366fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:f1:99:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "vif_mac": "fa:16:3e:f1:99:a3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.objects.instance [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'pci_devices' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:02:16 user nova-compute[71285]:   <uuid>02be72c4-1b93-4639-86f2-05570a6366fe</uuid>
Apr 13 21:02:16 user nova-compute[71285]:   <name>instance-0000002e</name>
Apr 13 21:02:16 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 21:02:16 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 21:02:16 user nova-compute[71285]:   <metadata>
Apr 13 21:02:16 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:02:16 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-646592594</nova:name>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:creationTime>2023-04-13 21:02:15</nova:creationTime>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 21:02:16 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:02:16 user nova-compute[71285]:       </nova:flavor>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:owner>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:user uuid="ce4e20ca99b8451c9087c565778ab88f">tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member</nova:user>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:project uuid="c9873771332b48b78929463707ce74d0">tempest-ServerBootFromVolumeStableRescueTest-1662309877</nova:project>
Apr 13 21:02:16 user nova-compute[71285]:       </nova:owner>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 21:02:16 user nova-compute[71285]:       <nova:ports>
Apr 13 21:02:16 user nova-compute[71285]:         <nova:port uuid="16c9b002-957a-4236-9d73-299ca369d311">
Apr 13 21:02:16 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 13 21:02:16 user nova-compute[71285]:         </nova:port>
Apr 13 21:02:16 user nova-compute[71285]:       </nova:ports>
Apr 13 21:02:16 user nova-compute[71285]:     </nova:instance>
Apr 13 21:02:16 user nova-compute[71285]:   </metadata>
Apr 13 21:02:16 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 21:02:16 user nova-compute[71285]:     <system>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="serial">02be72c4-1b93-4639-86f2-05570a6366fe</entry>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="uuid">02be72c4-1b93-4639-86f2-05570a6366fe</entry>
Apr 13 21:02:16 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:02:16 user nova-compute[71285]:     </system>
Apr 13 21:02:16 user nova-compute[71285]:   </sysinfo>
Apr 13 21:02:16 user nova-compute[71285]:   <os>
Apr 13 21:02:16 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:02:16 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 21:02:16 user nova-compute[71285]:   </os>
Apr 13 21:02:16 user nova-compute[71285]:   <features>
Apr 13 21:02:16 user nova-compute[71285]:     <acpi/>
Apr 13 21:02:16 user nova-compute[71285]:     <apic/>
Apr 13 21:02:16 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 21:02:16 user nova-compute[71285]:   </features>
Apr 13 21:02:16 user nova-compute[71285]:   <clock offset="utc">
Apr 13 21:02:16 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:02:16 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:02:16 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 21:02:16 user nova-compute[71285]:   </clock>
Apr 13 21:02:16 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 21:02:16 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 21:02:16 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:02:16 user nova-compute[71285]:   </cpu>
Apr 13 21:02:16 user nova-compute[71285]:   <devices>
Apr 13 21:02:16 user nova-compute[71285]:     <disk type="block" device="disk">
Apr 13 21:02:16 user nova-compute[71285]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 13 21:02:16 user nova-compute[71285]:       <source dev="/dev/sdc"/>
Apr 13 21:02:16 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 21:02:16 user nova-compute[71285]:       <serial>0d87e363-af15-4053-bd86-dbbea6677351</serial>
Apr 13 21:02:16 user nova-compute[71285]:     </disk>
Apr 13 21:02:16 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 21:02:16 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:02:16 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue"/>
Apr 13 21:02:16 user nova-compute[71285]:       <target dev="vdb" bus="virtio"/>
Apr 13 21:02:16 user nova-compute[71285]:       <boot order="1"/>
Apr 13 21:02:16 user nova-compute[71285]:     </disk>
Apr 13 21:02:16 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 21:02:16 user nova-compute[71285]:       <mac address="fa:16:3e:f1:99:a3"/>
Apr 13 21:02:16 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:02:16 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 21:02:16 user nova-compute[71285]:       <target dev="tap16c9b002-95"/>
Apr 13 21:02:16 user nova-compute[71285]:     </interface>
Apr 13 21:02:16 user nova-compute[71285]:     <serial type="pty">
Apr 13 21:02:16 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/console.log" append="off"/>
Apr 13 21:02:16 user nova-compute[71285]:     </serial>
Apr 13 21:02:16 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:02:16 user nova-compute[71285]:     <video>
Apr 13 21:02:16 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:02:16 user nova-compute[71285]:     </video>
Apr 13 21:02:16 user nova-compute[71285]:     <rng model="virtio">
Apr 13 21:02:16 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:02:16 user nova-compute[71285]:     </rng>
Apr 13 21:02:16 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:02:16 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 21:02:16 user nova-compute[71285]:       <stats period="10"/>
Apr 13 21:02:16 user nova-compute[71285]:     </memballoon>
Apr 13 21:02:16 user nova-compute[71285]:   </devices>
Apr 13 21:02:16 user nova-compute[71285]: </domain>
Apr 13 21:02:16 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:02:16 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance destroyed successfully.
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] No VIF found with MAC fa:16:3e:f1:99:a3, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:02:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:17 user nova-compute[71285]: DEBUG nova.compute.manager [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:02:17 user nova-compute[71285]: WARNING nova.compute.manager [req-1e958212-4e77-4857-a599-3485416fc2de req-7f482215-9471-4254-8c31-6d5ae8345c4c service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state active and task_state rescuing.
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 02be72c4-1b93-4639-86f2-05570a6366fe due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419739.690573, 02be72c4-1b93-4639-86f2-05570a6366fe => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:02:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Resumed (Lifecycle Event)
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-228ed93f-7a4e-42e2-8f70-f7f7f63e192f tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:02:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419739.694662, 02be72c4-1b93-4639-86f2-05570a6366fe => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:02:19 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Started (Lifecycle Event)
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:19 user nova-compute[71285]: DEBUG nova.compute.manager [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:02:19 user nova-compute[71285]: WARNING nova.compute.manager [req-6513c0cc-f97b-4a84-b1b3-88bf5c2e45b0 req-f4e19e8f-42ff-4b38-8e8e-e0cc6cf22f36 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state rescued and task_state None.
Apr 13 21:02:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:02:22 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:02:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:24 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:25 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:02:25 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=26.07376480102539GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:02:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:02:26 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:02:26 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:02:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:02:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:02:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:02:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:02:32 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:02:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:02:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [{"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-ec312720-9493-463e-96b6-2e659ac966b2" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:03:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:25 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:03:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:03:26 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=26.073074340820312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:03:26 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:03:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:03:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:03:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:32 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:03:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:43 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:03:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:03:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:04:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:03 user nova-compute[71285]: INFO nova.compute.manager [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Unrescuing
Apr 13 21:04:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:04:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquired lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:04:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:04:03 user nova-compute[71285]: DEBUG nova.network.neutron [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:04:03 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Releasing lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:04:03 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'flavor' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG nova.compute.manager [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:04:04 user nova-compute[71285]: WARNING nova.compute.manager [req-4c61fbc7-2341-44f0-9c27-145bc4f0a9bf req-ed713c21-d84f-42e5-bc6c-a28858f60f9a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:04:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:04 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:04 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance destroyed successfully.
Apr 13 21:04:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:04:06 user nova-compute[71285]: WARNING nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:04:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:06 user nova-compute[71285]: DEBUG nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:04:06 user nova-compute[71285]: WARNING nova.compute.manager [req-01070b79-ff68-4e01-86d4-4008ee93e899 req-47596a97-64c1-4d35-ab84-3a0346abfab0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state rescued and task_state unrescuing.
Apr 13 21:04:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.virt.libvirt.host [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Removed pending event for 02be72c4-1b93-4639-86f2-05570a6366fe due to event {{(pid=71285) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419848.1367426, 02be72c4-1b93-4639-86f2-05570a6366fe => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:04:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Resumed (Lifecycle Event)
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e1fb899e-8580-4e7f-80c7-67e45f4e2240 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:04:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681419848.1402686, 02be72c4-1b93-4639-86f2-05570a6366fe => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:04:08 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Started (Lifecycle Event)
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:08 user nova-compute[71285]: DEBUG nova.compute.manager [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:04:08 user nova-compute[71285]: WARNING nova.compute.manager [req-9bb0f0ec-02c1-405c-88bf-e892189f1579 req-7fd9ced7-f650-4363-a407-16c454cbf1e0 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state active and task_state None.
Apr 13 21:04:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:04:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [{"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-02be72c4-1b93-4639-86f2-05570a6366fe" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:04:23 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:04:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:04:26 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:04:27 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:04:27 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8597MB free_disk=26.072006225585938GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:04:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:04:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:34 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:04:34 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:04:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:04:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:04:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:14 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:22 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [{"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:05:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:28 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:05:28 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=26.071392059326172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance 02be72c4-1b93-4639-86f2-05570a6366fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:05:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:34 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:05:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:05:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:05:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:05:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:48 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid ec312720-9493-463e-96b6-2e659ac966b2 {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Triggering sync for uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "ec312720-9493-463e-96b6-2e659ac966b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "ec312720-9493-463e-96b6-2e659ac966b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: INFO nova.compute.manager [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Terminating instance
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:05:54 user nova-compute[71285]: DEBUG nova.compute.manager [req-e2e4e4cc-1fb5-4ceb-82df-690d1aa306e3 req-bfbeca95-27fb-49bb-a2ba-f5c03b9f609a service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-unplugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:55 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Instance destroyed successfully.
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.objects.instance [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid 02be72c4-1b93-4639-86f2-05570a6366fe {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-646592594',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-646592594',id=46,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-0avuc9pr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:04:08Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=02be72c4-1b93-4639-86f2-05570a6366fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "16c9b002-957a-4236-9d73-299ca369d311", "address": "fa:16:3e:f1:99:a3", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16c9b002-95", "ovs_interfaceid": "16c9b002-957a-4236-9d73-299ca369d311", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_vif [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16c9b002-95, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:05:55 user nova-compute[71285]: INFO os_vif [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:99:a3,bridge_name='br-int',has_traffic_filtering=True,id=16c9b002-957a-4236-9d73-299ca369d311,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16c9b002-95')
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odDPvKNc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:05:55 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ed755-99d8-4200-9967-e4e50d74dc0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:05:55 user nova-compute[71285]: No targets found.
Apr 13 21:05:55 user nova-compute[71285]: iSNS:
Apr 13 21:05:55 user nova-compute[71285]: No targets found.
Apr 13 21:05:55 user nova-compute[71285]: STATIC:
Apr 13 21:05:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019
Apr 13 21:05:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:05:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 21:05:55 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351
Apr 13 21:05:55 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:05:55 user nova-compute[71285]:                 Iface Name: default
Apr 13 21:05:55 user nova-compute[71285]: FIRMWARE:
Apr 13 21:05:55 user nova-compute[71285]: No targets found.
Apr 13 21:05:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:05:55 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:05:55 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d44fce-f27d-4fca-b89e-f5a1149a31f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8598c4b1-2fde-4a2b-80a2-7fab3cc6ef2c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:05:55 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:05:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:05:55 user nova-compute[71285]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 (non-flash)
Apr 13 21:05:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc6433dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351'): ({'sdc'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Removing single pathed devices sdc {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d9a7c4-019e-410a-b915-ae22084b55af]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[701202f6-8ce0-4839-ab46-b225be92fdc1]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flushing IO for device /dev/sdc {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41dda6-55d3-4805-8b6e-d63e845aa23a]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[98096877-cac7-4295-a085-2a1fb01b5d97]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] SCSI volumes sdc have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171b3cf-70ca-48d6-b982-c8efb415cc9e]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e7793f-781c-4ede-8504-fd1441b499e2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260]
Apr 13 21:05:55 user nova-compute[71285]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351, portal: 172.16.0.220,3260] successful.
Apr 13 21:05:55 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d87e363-af15-4053-bd86-dbbea6677351 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78ef724-be12-4599-8978-8fdb78973eb9]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== disconnect_volume: return (325ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:05:55 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Deleting instance files /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe_del
Apr 13 21:05:55 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Deletion of /opt/stack/data/nova/instances/02be72c4-1b93-4639-86f2-05570a6366fe_del complete
Apr 13 21:05:55 user nova-compute[71285]: INFO nova.compute.manager [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 13 21:05:55 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:05:55 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:05:56 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:05:56 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Took 0.49 seconds to deallocate network for instance.
Apr 13 21:05:56 user nova-compute[71285]: DEBUG nova.compute.manager [req-0d8e0901-7463-4f6a-928a-f8b8a0bc6261 req-e36c5739-8da0-4410-93a1-c45c7dd861c3 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-deleted-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Acquiring lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] Lock "02be72c4-1b93-4639-86f2-05570a6366fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] No waiting events found dispatching network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:05:57 user nova-compute[71285]: WARNING nova.compute.manager [req-3e772e52-ce7c-4773-80a0-761250b78b22 req-d8afe614-48b1-446e-9481-188ec4d19684 service nova] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Received unexpected event network-vif-plugged-16c9b002-957a-4236-9d73-299ca369d311 for instance with vm_state active and task_state deleting.
Apr 13 21:05:57 user nova-compute[71285]: INFO nova.compute.manager [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Took 0.84 seconds to detach 1 volumes for instance.
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:57 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Deleted allocations for instance 02be72c4-1b93-4639-86f2-05570a6366fe
Apr 13 21:05:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-4b1d63ef-c363-4444-b1e7-8edda00f0fb4 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "02be72c4-1b93-4639-86f2-05570a6366fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:05:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681419955.404598, 02be72c4-1b93-4639-86f2-05570a6366fe => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:06:10 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] VM Stopped (Lifecycle Event)
Apr 13 21:06:10 user nova-compute[71285]: DEBUG nova.compute.manager [None req-be34ebc4-1083-4356-8ad8-cc11a7ffda29 None None] [instance: 02be72c4-1b93-4639-86f2-05570a6366fe] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:16 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:24 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [{"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-a559c005-897e-4c1c-bdc2-a2dce95573e9" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:06:25 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:06:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:06:27 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:06:28 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:06:28 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=26.07052993774414GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance ec312720-9493-463e-96b6-2e659ac966b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:06:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:34 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:06:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:06:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:40 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:45 user nova-compute[71285]: INFO nova.compute.manager [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Terminating instance
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.compute.manager [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-unplugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] No waiting events found dispatching network-vif-unplugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.compute.manager [req-74357da3-8f8b-4b48-abeb-a08c096a97cf req-2272f8fd-70a0-46e1-9294-e60726df408e service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-unplugged-58154f44-c606-4862-a417-27ec125c2d26 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Instance destroyed successfully.
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.objects.instance [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid ec312720-9493-463e-96b6-2e659ac966b2 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1875948222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1875948222',id=45,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:57:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ehs8o4dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:59:20Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=ec312720-9493-463e-96b6-2e659ac966b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "58154f44-c606-4862-a417-27ec125c2d26", "address": "fa:16:3e:e8:ec:0d", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58154f44-c6", "ovs_interfaceid": "58154f44-c606-4862-a417-27ec125c2d26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG os_vif [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58154f44-c6, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:45 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:45 user nova-compute[71285]: INFO os_vif [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ec:0d,bridge_name='br-int',has_traffic_filtering=True,id=58154f44-c606-4862-a417-27ec125c2d26,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58154f44-c6')
Apr 13 21:06:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Deleting instance files /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2_del
Apr 13 21:06:45 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Deletion of /opt/stack/data/nova/instances/ec312720-9493-463e-96b6-2e659ac966b2_del complete
Apr 13 21:06:46 user nova-compute[71285]: INFO nova.compute.manager [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 13 21:06:46 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:06:46 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Took 0.44 seconds to deallocate network for instance.
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-deleted-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:06:46 user nova-compute[71285]: INFO nova.compute.manager [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Neutron deleted interface 58154f44-c606-4862-a417-27ec125c2d26; detaching it from the instance and deleting it from the info cache
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.network.neutron [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.compute.manager [req-cf49823e-13d0-426f-aa9e-9905fe04fde9 req-04b537d3-3407-499a-a32d-45611379be30 service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Detach interface failed, port_id=58154f44-c606-4862-a417-27ec125c2d26, reason: Instance ec312720-9493-463e-96b6-2e659ac966b2 could not be found. {{(pid=71285) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:06:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:46 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Deleted allocations for instance ec312720-9493-463e-96b6-2e659ac966b2
Apr 13 21:06:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-5d4fd84b-0a76-49dd-b93a-e41b9c5a3fdb tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "ec312720-9493-463e-96b6-2e659ac966b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.496s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:06:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Acquiring lock "ec312720-9493-463e-96b6-2e659ac966b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:06:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:06:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] Lock "ec312720-9493-463e-96b6-2e659ac966b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:06:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] No waiting events found dispatching network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:06:47 user nova-compute[71285]: WARNING nova.compute.manager [req-a6622d12-350f-43bd-80f2-c8a871f36fa5 req-1d672f24-d8cc-47ad-8f2c-339ab9caa21c service nova] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Received unexpected event network-vif-plugged-58154f44-c606-4862-a417-27ec125c2d26 for instance with vm_state deleted and task_state None.
Apr 13 21:06:50 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:06:55 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:00 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681420005.9254627, ec312720-9493-463e-96b6-2e659ac966b2 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:07:00 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: ec312720-9493-463e-96b6-2e659ac966b2] VM Stopped (Lifecycle Event)
Apr 13 21:07:00 user nova-compute[71285]: DEBUG nova.compute.manager [None req-27e1e37d-99b8-4067-9206-6ba947b07381 None None] [instance: ec312720-9493-463e-96b6-2e659ac966b2] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:07:00 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:05 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:10 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:15 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:18 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:20 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:25 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:25 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:07:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:07:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71285) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:29 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:07:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=26.16143035888672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance a559c005-897e-4c1c-bdc2-a2dce95573e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:30 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:32 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:35 user nova-compute[71285]: INFO nova.compute.manager [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Terminating instance
Apr 13 21:07:35 user nova-compute[71285]: DEBUG nova.compute.manager [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:35 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.compute.manager [req-9d1c1de2-9e51-4637-a35c-e405b2a38544 req-287b388f-1cb6-4806-b230-0a8b65f0c5f2 service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-unplugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:07:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Instance destroyed successfully.
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.objects.instance [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid a559c005-897e-4c1c-bdc2-a2dce95573e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:51:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1443572831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1443572831',id=44,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:53:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-oytlioo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:55:38Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=a559c005-897e-4c1c-bdc2-a2dce95573e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "address": "fa:16:3e:05:71:a7", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca77217a-aa", "ovs_interfaceid": "ca77217a-aa63-4648-a54c-9f4d807d1acb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_vif [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca77217a-aa, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:36 user nova-compute[71285]: INFO os_vif [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:71:a7,bridge_name='br-int',has_traffic_filtering=True,id=ca77217a-aa63-4648-a54c-9f4d807d1acb,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca77217a-aa')
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] calling os-brick to detach iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fdc64184190>, {'target_iqn': 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aiHTGZup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 13 21:07:36 user nova-compute[71285]: WARNING os_brick.initiator.connectors.base [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61c063-acf1-4d6a-aee3-0c6ce4d2b32f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 13 21:07:36 user nova-compute[71285]: No targets found.
Apr 13 21:07:36 user nova-compute[71285]: iSNS:
Apr 13 21:07:36 user nova-compute[71285]: No targets found.
Apr 13 21:07:36 user nova-compute[71285]: STATIC:
Apr 13 21:07:36 user nova-compute[71285]: Target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019
Apr 13 21:07:36 user nova-compute[71285]:         Portal: 172.16.0.220:3260,-1
Apr 13 21:07:36 user nova-compute[71285]:                 Iface Name: default
Apr 13 21:07:36 user nova-compute[71285]: FIRMWARE:
Apr 13 21:07:36 user nova-compute[71285]: No targets found.
Apr 13 21:07:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 13 21:07:36 user nova-compute[71285]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 13 21:07:36 user nova-compute[71285]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71285) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019', 0)] {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9d42e-8e68-4f81-bbb3-aec71b093488]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[785be40b-4ca6-4e17-9fa0-40faae89f69a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:07:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 (non-flash)
Apr 13 21:07:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fdc3861a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019'): ({'sdb'}, set())}) {{(pid=71285) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Removing single pathed devices sdb {{(pid=71285) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[2345de9f-bc97-4264-b592-86a1e98f4817]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b6006d-791f-4c29-bfba-a3e91e03e278]: (4, ('ok\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Flushing IO for device /dev/sdb {{(pid=71285) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[81793585-f824-4b09-85bf-221b366590f7]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71285) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8472e3ab-828f-4f72-a6c1-afde8a2973b3]: (4, ('1', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.linuxscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] SCSI volumes sdb have been removed. {{(pid=71285) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019')] {{(pid=71285) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1540059-9af5-4aed-8e8e-3953419b2012]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --logout {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95dee1-088a-4f32-908d-403f849a2396]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260]
Apr 13 21:07:36 user nova-compute[71285]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019, portal: 172.16.0.220,3260] successful.
Apr 13 21:07:36 user nova-compute[71285]:  stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op delete {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c3546a8-ff4c-4cce-a64b-d9f8f8c83019 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81283) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.privsep.daemon [-] privsep: reply[07885ff4-166b-4143-8701-dd97734a7f79]: (4, ('', '')) {{(pid=81283) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71285) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.base [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] <== disconnect_volume: return (309ms) None {{(pid=71285) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Disconnected iSCSI Volume {{(pid=71285) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 13 21:07:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Deleting instance files /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9_del
Apr 13 21:07:36 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Deletion of /opt/stack/data/nova/instances/a559c005-897e-4c1c-bdc2-a2dce95573e9_del complete
Apr 13 21:07:36 user nova-compute[71285]: INFO nova.compute.manager [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 13 21:07:36 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:07:36 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:07:37 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:07:37 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Took 0.47 seconds to deallocate network for instance.
Apr 13 21:07:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Acquiring lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] No waiting events found dispatching network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:07:38 user nova-compute[71285]: WARNING nova.compute.manager [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received unexpected event network-vif-plugged-ca77217a-aa63-4648-a54c-9f4d807d1acb for instance with vm_state active and task_state deleting.
Apr 13 21:07:38 user nova-compute[71285]: DEBUG nova.compute.manager [req-1561ea0e-c063-4e13-b92d-dcd90521a361 req-2a4d9261-6c22-4cad-8a00-3601902bb61a service nova] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Received event network-vif-deleted-ca77217a-aa63-4648-a54c-9f4d807d1acb {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:07:38 user nova-compute[71285]: INFO nova.compute.manager [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Took 0.85 seconds to detach 1 volumes for instance.
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:38 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Deleted allocations for instance a559c005-897e-4c1c-bdc2-a2dce95573e9
Apr 13 21:07:38 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-f7f90bcb-9ac4-49d2-aa1f-1c0b3e124a73 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "a559c005-897e-4c1c-bdc2-a2dce95573e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:07:41 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:07:51 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:07:51 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681420056.5167677, a559c005-897e-4c1c-bdc2-a2dce95573e9 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:07:51 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] VM Stopped (Lifecycle Event)
Apr 13 21:07:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-099c3e5f-b9f4-44be-ac64-0595b37fc0d7 None None] [instance: a559c005-897e-4c1c-bdc2-a2dce95573e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:07:51 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:07:56 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:01 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:06 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:11 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:16 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:21 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:26 user nova-compute[71285]: INFO nova.compute.manager [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Terminating instance
Apr 13 21:08:26 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-unplugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] No waiting events found dispatching network-vif-unplugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:08:26 user nova-compute[71285]: DEBUG nova.compute.manager [req-da49457f-e14c-48b3-aed4-d011cd1bb462 req-da2d7e20-7bb4-4857-bc49-f9fcd0ff0485 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-unplugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Instance destroyed successfully.
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lazy-loading 'resources' on Instance uuid fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T20:48:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-48633921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-48633921',id=43,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T20:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9873771332b48b78929463707ce74d0',ramdisk_id='',reservation_id='r-ym17o2to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T20:50:49Z,user_data=None,user_id='ce4e20ca99b8451c9087c565778ab88f',uuid=fe45ba7c-ccc0-4eaa-930c-6600e036f3e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converting VIF {"id": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "address": "fa:16:3e:2a:7b:94", "network": {"id": "b179b938-6cf3-4860-b1ac-e243ded4df5f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1166163652-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9873771332b48b78929463707ce74d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7010d8a1-cb", "ovs_interfaceid": "7010d8a1-cb74-49c7-9be0-dc0da456ad67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG os_vif [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7010d8a1-cb, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:27 user nova-compute[71285]: INFO os_vif [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7b:94,bridge_name='br-int',has_traffic_filtering=True,id=7010d8a1-cb74-49c7-9be0-dc0da456ad67,network=Network(b179b938-6cf3-4860-b1ac-e243ded4df5f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7010d8a1-cb')
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Deleting instance files /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9_del
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Deletion of /opt/stack/data/nova/instances/fe45ba7c-ccc0-4eaa-930c-6600e036f3e9_del complete
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.compute.manager [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 13 21:08:27 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Skipping network cache update for instance because it is being deleted. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Took 0.44 seconds to deallocate network for instance.
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.manager [req-9529cece-22b8-41bc-9408-2bb040fd87c1 req-1d7f6293-4839-4478-a3de-7a2a5f55c104 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-deleted-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:08:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:27 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Deleted allocations for instance fe45ba7c-ccc0-4eaa-930c-6600e036f3e9
Apr 13 21:08:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-e7770c8d-38a2-4060-afc5-461cede27e65 tempest-ServerBootFromVolumeStableRescueTest-1662309877 tempest-ServerBootFromVolumeStableRescueTest-1662309877-project-member] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.591s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:08:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Acquiring lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:29 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] Lock "fe45ba7c-ccc0-4eaa-930c-6600e036f3e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:29 user nova-compute[71285]: DEBUG nova.compute.manager [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] No waiting events found dispatching network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:08:29 user nova-compute[71285]: WARNING nova.compute.manager [req-e5a488df-1e81-4855-8571-a2fe0036cc34 req-220a8c92-1989-4a82-8a1c-77a736ecd5a0 service nova] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Received unexpected event network-vif-plugged-7010d8a1-cb74-49c7-9be0-dc0da456ad67 for instance with vm_state deleted and task_state None.
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:08:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:08:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:08:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8914MB free_disk=26.25210189819336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:08:30 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:08:31 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:08:31 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:08:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:08:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:08:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:08:42 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681420107.2114081, fe45ba7c-ccc0-4eaa-930c-6600e036f3e9 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:08:42 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] VM Stopped (Lifecycle Event)
Apr 13 21:08:42 user nova-compute[71285]: DEBUG nova.compute.manager [None req-e2f8e0f5-45a4-4ac0-bb27-5a53684361cd None None] [instance: fe45ba7c-ccc0-4eaa-930c-6600e036f3e9] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:08:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:08:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:08:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:09:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:09:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:09:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:29 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:09:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:09:30 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=26.250946044921875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:09:30 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:34 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:09:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:09:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:50 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:50 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Starting instance... {{(pid=71285) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71285) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 13 21:09:51 user nova-compute[71285]: INFO nova.compute.claims [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Claim successful on node user
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Start building networks asynchronously for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Allocating IP information in the background. {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] allocate_for_instance() {{(pid=71285) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 13 21:09:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Start building block device mappings for instance. {{(pid=71285) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.policy [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b257c12138104e35a1d01a5614746f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '413fbcd3c8f14d5bae809dc4a7f1acf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71285) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Start spawning the instance on the hypervisor. {{(pid=71285) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Creating instance directory {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 13 21:09:51 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Creating image(s)
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "/opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "/opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.139s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.135s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk 1073741824 {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2,backing_fmt=raw /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk 1073741824" returned: 0 in 0.056s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "e8edcb70ec54e8d499649ccc13333ab079fbd8b2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e8edcb70ec54e8d499649ccc13333ab079fbd8b2 --force-share --output=json" returned: 0 in 0.136s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk. size=1073741824 {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 13 21:09:51 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Successfully created port: 81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.virt.disk.api [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Cannot resize image /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk to a smaller size. {{(pid=71285) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.objects.instance [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lazy-loading 'migration_context' on Instance uuid bd531840-5dda-4126-be71-9a7352f34e10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Created local disks {{(pid=71285) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Ensure instance console log exists: /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/console.log {{(pid=71285) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Successfully updated port: 81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquired lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Building network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-changed-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.compute.manager [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Refreshing instance network info cache due to event network-changed-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a. {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Acquiring lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:09:52 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Instance cache missing network info. {{(pid=71285) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.neutron [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updating instance_info_cache with network_info: [{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Releasing lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Instance network_info: |[{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71285) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Acquired lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Refreshing network info cache for port 81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Start _get_guest_xml network_info=[{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_name': '/dev/vda', 'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'boot_index': 0, 'encryption_format': None, 'device_type': 'disk', 'encryption_options': None, 'disk_bus': 'virtio', 'image_id': '89a0e641-f418-4fdd-8f20-480666e0188c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 13 21:09:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:09:53 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71285) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-13T20:16:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-13T20:15:04Z,direct_url=<?>,disk_format='qcow2',id=89a0e641-f418-4fdd-8f20-480666e0188c,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='119ae20419f24e47b2ffb6688bf6c4b7',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-13T20:15:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Flavor limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Image limits 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Flavor pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Image pref 0:0:0 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71285) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Got 1 possible topologies {{(pid=71285) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.hardware [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71285) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2145808937',display_name='tempest-VolumesActionsTest-instance-2145808937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2145808937',id=47,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='413fbcd3c8f14d5bae809dc4a7f1acf9',ramdisk_id='',reservation_id='r-ale3gw3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1712081347',owner_user_name='tempest-VolumesActionsTest-1712081347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:09:51Z,user_data=None,user_id='b257c12138104e35a1d01a5614746f95',uuid=bd531840-5dda-4126-be71-9a7352f34e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71285) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converting VIF {"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.objects.instance [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lazy-loading 'pci_devices' on Instance uuid bd531840-5dda-4126-be71-9a7352f34e10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] End _get_guest_xml xml=<domain type="kvm">
Apr 13 21:09:53 user nova-compute[71285]:   <uuid>bd531840-5dda-4126-be71-9a7352f34e10</uuid>
Apr 13 21:09:53 user nova-compute[71285]:   <name>instance-0000002f</name>
Apr 13 21:09:53 user nova-compute[71285]:   <memory>131072</memory>
Apr 13 21:09:53 user nova-compute[71285]:   <vcpu>1</vcpu>
Apr 13 21:09:53 user nova-compute[71285]:   <metadata>
Apr 13 21:09:53 user nova-compute[71285]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 13 21:09:53 user nova-compute[71285]:       <nova:package version="0.0.0"/>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:name>tempest-VolumesActionsTest-instance-2145808937</nova:name>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:creationTime>2023-04-13 21:09:53</nova:creationTime>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:flavor name="m1.nano">
Apr 13 21:09:53 user nova-compute[71285]:         <nova:memory>128</nova:memory>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:disk>1</nova:disk>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:swap>0</nova:swap>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:ephemeral>0</nova:ephemeral>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:vcpus>1</nova:vcpus>
Apr 13 21:09:53 user nova-compute[71285]:       </nova:flavor>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:owner>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:user uuid="b257c12138104e35a1d01a5614746f95">tempest-VolumesActionsTest-1712081347-project-member</nova:user>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:project uuid="413fbcd3c8f14d5bae809dc4a7f1acf9">tempest-VolumesActionsTest-1712081347</nova:project>
Apr 13 21:09:53 user nova-compute[71285]:       </nova:owner>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:root type="image" uuid="89a0e641-f418-4fdd-8f20-480666e0188c"/>
Apr 13 21:09:53 user nova-compute[71285]:       <nova:ports>
Apr 13 21:09:53 user nova-compute[71285]:         <nova:port uuid="81bf96c1-a9af-41c0-8ef3-10b6f795ff8a">
Apr 13 21:09:53 user nova-compute[71285]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 13 21:09:53 user nova-compute[71285]:         </nova:port>
Apr 13 21:09:53 user nova-compute[71285]:       </nova:ports>
Apr 13 21:09:53 user nova-compute[71285]:     </nova:instance>
Apr 13 21:09:53 user nova-compute[71285]:   </metadata>
Apr 13 21:09:53 user nova-compute[71285]:   <sysinfo type="smbios">
Apr 13 21:09:53 user nova-compute[71285]:     <system>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="product">OpenStack Nova</entry>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="version">0.0.0</entry>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="serial">bd531840-5dda-4126-be71-9a7352f34e10</entry>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="uuid">bd531840-5dda-4126-be71-9a7352f34e10</entry>
Apr 13 21:09:53 user nova-compute[71285]:       <entry name="family">Virtual Machine</entry>
Apr 13 21:09:53 user nova-compute[71285]:     </system>
Apr 13 21:09:53 user nova-compute[71285]:   </sysinfo>
Apr 13 21:09:53 user nova-compute[71285]:   <os>
Apr 13 21:09:53 user nova-compute[71285]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 13 21:09:53 user nova-compute[71285]:     <boot dev="hd"/>
Apr 13 21:09:53 user nova-compute[71285]:     <smbios mode="sysinfo"/>
Apr 13 21:09:53 user nova-compute[71285]:   </os>
Apr 13 21:09:53 user nova-compute[71285]:   <features>
Apr 13 21:09:53 user nova-compute[71285]:     <acpi/>
Apr 13 21:09:53 user nova-compute[71285]:     <apic/>
Apr 13 21:09:53 user nova-compute[71285]:     <vmcoreinfo/>
Apr 13 21:09:53 user nova-compute[71285]:   </features>
Apr 13 21:09:53 user nova-compute[71285]:   <clock offset="utc">
Apr 13 21:09:53 user nova-compute[71285]:     <timer name="pit" tickpolicy="delay"/>
Apr 13 21:09:53 user nova-compute[71285]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 13 21:09:53 user nova-compute[71285]:     <timer name="hpet" present="no"/>
Apr 13 21:09:53 user nova-compute[71285]:   </clock>
Apr 13 21:09:53 user nova-compute[71285]:   <cpu mode="custom" match="exact">
Apr 13 21:09:53 user nova-compute[71285]:     <model>Nehalem</model>
Apr 13 21:09:53 user nova-compute[71285]:     <topology sockets="1" cores="1" threads="1"/>
Apr 13 21:09:53 user nova-compute[71285]:   </cpu>
Apr 13 21:09:53 user nova-compute[71285]:   <devices>
Apr 13 21:09:53 user nova-compute[71285]:     <disk type="file" device="disk">
Apr 13 21:09:53 user nova-compute[71285]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 13 21:09:53 user nova-compute[71285]:       <source file="/opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk"/>
Apr 13 21:09:53 user nova-compute[71285]:       <target dev="vda" bus="virtio"/>
Apr 13 21:09:53 user nova-compute[71285]:     </disk>
Apr 13 21:09:53 user nova-compute[71285]:     <interface type="ethernet">
Apr 13 21:09:53 user nova-compute[71285]:       <mac address="fa:16:3e:b9:52:a0"/>
Apr 13 21:09:53 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:09:53 user nova-compute[71285]:       <mtu size="1442"/>
Apr 13 21:09:53 user nova-compute[71285]:       <target dev="tap81bf96c1-a9"/>
Apr 13 21:09:53 user nova-compute[71285]:     </interface>
Apr 13 21:09:53 user nova-compute[71285]:     <serial type="pty">
Apr 13 21:09:53 user nova-compute[71285]:       <log file="/opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/console.log" append="off"/>
Apr 13 21:09:53 user nova-compute[71285]:     </serial>
Apr 13 21:09:53 user nova-compute[71285]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 13 21:09:53 user nova-compute[71285]:     <video>
Apr 13 21:09:53 user nova-compute[71285]:       <model type="virtio"/>
Apr 13 21:09:53 user nova-compute[71285]:     </video>
Apr 13 21:09:53 user nova-compute[71285]:     <rng model="virtio">
Apr 13 21:09:53 user nova-compute[71285]:       <backend model="random">/dev/urandom</backend>
Apr 13 21:09:53 user nova-compute[71285]:     </rng>
Apr 13 21:09:53 user nova-compute[71285]:     <controller type="usb" index="0" model="none"/>
Apr 13 21:09:53 user nova-compute[71285]:     <memballoon model="virtio">
Apr 13 21:09:53 user nova-compute[71285]:       <stats period="10"/>
Apr 13 21:09:53 user nova-compute[71285]:     </memballoon>
Apr 13 21:09:53 user nova-compute[71285]:   </devices>
Apr 13 21:09:53 user nova-compute[71285]: </domain>
Apr 13 21:09:53 user nova-compute[71285]:  {{(pid=71285) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2145808937',display_name='tempest-VolumesActionsTest-instance-2145808937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2145808937',id=47,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='413fbcd3c8f14d5bae809dc4a7f1acf9',ramdisk_id='',reservation_id='r-ale3gw3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1712081347',owner_user_name='tempest-VolumesActionsTest-1712081347-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-13T21:09:51Z,user_data=None,user_id='b257c12138104e35a1d01a5614746f95',uuid=bd531840-5dda-4126-be71-9a7352f34e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converting VIF {"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG os_vif [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9') {{(pid=71285) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81bf96c1-a9, may_exist=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81bf96c1-a9, col_values=(('external_ids', {'iface-id': '81bf96c1-a9af-41c0-8ef3-10b6f795ff8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:52:a0', 'vm-uuid': 'bd531840-5dda-4126-be71-9a7352f34e10'}),)) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:53 user nova-compute[71285]: INFO os_vif [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9')
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] No BDM found with device name vda, not building metadata. {{(pid=71285) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] No VIF found with MAC fa:16:3e:b9:52:a0, not building metadata {{(pid=71285) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updated VIF entry in instance network info cache for port 81bf96c1-a9af-41c0-8ef3-10b6f795ff8a. {{(pid=71285) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG nova.network.neutron [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updating instance_info_cache with network_info: [{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:09:53 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-e22c5d34-b7fe-4121-bbfb-aa6d7c332882 req-abd65f39-2f91-460f-b8db-ed348e0f93d6 service nova] Releasing lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:09:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:54 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:09:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:55 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:55 user nova-compute[71285]: DEBUG nova.compute.manager [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] No waiting events found dispatching network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:09:55 user nova-compute[71285]: WARNING nova.compute.manager [req-cce2cb55-1dda-4a27-9f49-9b7ead1e4b88 req-2e9c1918-3c61-41fc-874b-b8e682ed870f service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received unexpected event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance with vm_state building and task_state spawning.
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681420196.689944, bd531840-5dda-4126-be71-9a7352f34e10 => Resumed> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] VM Resumed (Lifecycle Event)
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Instance event wait completed in 0 seconds for  {{(pid=71285) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Guest created on hypervisor {{(pid=71285) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Instance spawned successfully.
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_cdrom_bus of ide {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_disk_bus of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_input_bus of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_pointer_model of None {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_video_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.libvirt.driver [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Found default for hw_vif_model of virtio {{(pid=71285) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.virt.driver [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] Emitting event <LifecycleEvent: 1681420196.6935058, bd531840-5dda-4126-be71-9a7352f34e10 => Started> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] VM Started (Lifecycle Event)
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71285) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-ab0bd12e-5ce9-4ab8-95cb-887e484dca56 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Took 5.31 seconds to spawn the instance on the hypervisor.
Apr 13 21:09:56 user nova-compute[71285]: DEBUG nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:09:56 user nova-compute[71285]: INFO nova.compute.manager [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Took 5.85 seconds to build instance.
Apr 13 21:09:56 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-321e38c3-5f8f-4952-8fce-4a05ac301a9d tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.957s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:09:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:09:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:09:57 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:09:57 user nova-compute[71285]: DEBUG nova.compute.manager [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] No waiting events found dispatching network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:09:57 user nova-compute[71285]: WARNING nova.compute.manager [req-bf4a2212-0288-4f8a-96bc-ea7e8e025993 req-3a9ced6e-8b7c-4c7d-ad12-49a337af7d40 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received unexpected event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance with vm_state active and task_state None.
Apr 13 21:09:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:09:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:19 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:10:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid bd531840-5dda-4126-be71-9a7352f34e10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:10:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updating instance_info_cache with network_info: [{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:10:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:10:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:10:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:10:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:10:32 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:10:32 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=26.221912384033203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance bd531840-5dda-4126-be71-9a7352f34e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing inventories for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating ProviderTree inventory for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Updating inventory in ProviderTree for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing aggregate associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, aggregates: None {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Refreshing trait associations for resource provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef, traits: COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=71285) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:10:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:37 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:10:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:44 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 13 21:10:44 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] There are 0 instances to clean {{(pid=71285) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:48 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:49 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:10:49 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71285) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 13 21:10:53 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:10:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:03 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:08 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:13 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:18 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:20 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:23 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquired lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Forcefully refreshing network info cache for instance {{(pid=71285) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 13 21:11:27 user nova-compute[71285]: DEBUG nova.objects.instance [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lazy-loading 'info_cache' on Instance uuid bd531840-5dda-4126-be71-9a7352f34e10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:11:28 user nova-compute[71285]: DEBUG nova.network.neutron [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updating instance_info_cache with network_info: [{"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:11:28 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Releasing lock "refresh_cache-bd531840-5dda-4126-be71-9a7352f34e10" {{(pid=71285) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 13 21:11:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updated the network info_cache for instance {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 13 21:11:28 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:30 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 13 21:11:31 user nova-compute[71285]: DEBUG oslo_concurrency.processutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71285) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 13 21:11:32 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:11:32 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=26.221324920654297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Instance bd531840-5dda-4126-be71-9a7352f34e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71285) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:11:32 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:33 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:36 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:38 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:11:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:43 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:46 user nova-compute[71285]: INFO nova.compute.manager [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Terminating instance
Apr 13 21:11:46 user nova-compute[71285]: DEBUG nova.compute.manager [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Start destroying the instance on the hypervisor. {{(pid=71285) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 13 21:11:46 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-unplugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] No waiting events found dispatching network-vif-unplugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.compute.manager [req-0e56bff3-7f06-48e6-ad9c-b1682d1cabcd req-e7a4f4a3-b060-49ab-a823-1981507c5bc8 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-unplugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance with task_state deleting. {{(pid=71285) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 13 21:11:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Instance destroyed successfully.
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.objects.instance [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lazy-loading 'resources' on Instance uuid bd531840-5dda-4126-be71-9a7352f34e10 {{(pid=71285) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.virt.libvirt.vif [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-13T21:09:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2145808937',display_name='tempest-VolumesActionsTest-instance-2145808937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2145808937',id=47,image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-13T21:09:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='413fbcd3c8f14d5bae809dc4a7f1acf9',ramdisk_id='',reservation_id='r-ale3gw3d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='89a0e641-f418-4fdd-8f20-480666e0188c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1712081347',owner_user_name='tempest-VolumesActionsTest-1712081347-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-13T21:09:57Z,user_data=None,user_id='b257c12138104e35a1d01a5614746f95',uuid=bd531840-5dda-4126-be71-9a7352f34e10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converting VIF {"id": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "address": "fa:16:3e:b9:52:a0", "network": {"id": "a8fd556a-48ba-4a57-96ce-322901415e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1757423516-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "413fbcd3c8f14d5bae809dc4a7f1acf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81bf96c1-a9", "ovs_interfaceid": "81bf96c1-a9af-41c0-8ef3-10b6f795ff8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.network.os_vif_util [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9') {{(pid=71285) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG os_vif [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9') {{(pid=71285) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81bf96c1-a9, bridge=br-int, if_exists=True) {{(pid=71285) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:11:47 user nova-compute[71285]: INFO os_vif [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:52:a0,bridge_name='br-int',has_traffic_filtering=True,id=81bf96c1-a9af-41c0-8ef3-10b6f795ff8a,network=Network(a8fd556a-48ba-4a57-96ce-322901415e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81bf96c1-a9')
Apr 13 21:11:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Deleting instance files /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10_del
Apr 13 21:11:47 user nova-compute[71285]: INFO nova.virt.libvirt.driver [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Deletion of /opt/stack/data/nova/instances/bd531840-5dda-4126-be71-9a7352f34e10_del complete
Apr 13 21:11:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:47 user nova-compute[71285]: INFO nova.compute.manager [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo.service.loopingcall [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71285) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.compute.manager [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Deallocating network for instance {{(pid=71285) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] deallocate_for_instance() {{(pid=71285) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG nova.network.neutron [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Updating instance_info_cache with network_info: [] {{(pid=71285) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 13 21:11:47 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Took 0.65 seconds to deallocate network for instance.
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:47 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:48 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:11:48 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:11:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:48 user nova-compute[71285]: INFO nova.scheduler.client.report [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Deleted allocations for instance bd531840-5dda-4126-be71-9a7352f34e10
Apr 13 21:11:48 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-8e6810fe-4e59-4b90-b208-fcd3ce114ef0 tempest-VolumesActionsTest-1712081347 tempest-VolumesActionsTest-1712081347-project-member] Lock "bd531840-5dda-4126-be71-9a7352f34e10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.626s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:11:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Acquiring lock "bd531840-5dda-4126-be71-9a7352f34e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:11:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:11:49 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] Lock "bd531840-5dda-4126-be71-9a7352f34e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:11:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] No waiting events found dispatching network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 13 21:11:49 user nova-compute[71285]: WARNING nova.compute.manager [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received unexpected event network-vif-plugged-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a for instance with vm_state deleted and task_state None.
Apr 13 21:11:49 user nova-compute[71285]: DEBUG nova.compute.manager [req-d3d3d5ce-8a50-4f9e-b95b-d697ebb959bd req-1a492b8d-cad4-422f-81b3-8b93b3622647 service nova] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Received event network-vif-deleted-81bf96c1-a9af-41c0-8ef3-10b6f795ff8a {{(pid=71285) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 13 21:11:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:11:56 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:11:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681420307.1221433, bd531840-5dda-4126-be71-9a7352f34e10 => Stopped> {{(pid=71285) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 13 21:12:02 user nova-compute[71285]: INFO nova.compute.manager [-] [instance: bd531840-5dda-4126-be71-9a7352f34e10] VM Stopped (Lifecycle Event)
Apr 13 21:12:02 user nova-compute[71285]: DEBUG nova.compute.manager [None req-53cdc601-acbe-4ee3-9c02-cf94dc190f1b None None] [instance: bd531840-5dda-4126-be71-9a7352f34e10] Checking state {{(pid=71285) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71285) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71285) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 13 21:12:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:27 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:28 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Starting heal instance info cache {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 13 21:12:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Rebuilding the list of instances to heal {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 13 21:12:28 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Didn't find any instances for network info cache update. {{(pid=71285) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 13 21:12:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:31 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:32 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Auditing locally available compute resources for user (node: user) {{(pid=71285) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 13 21:12:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:12:33 user nova-compute[71285]: WARNING nova.virt.libvirt.driver [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=26.238910675048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71285) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71285) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.provider_tree [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed in ProviderTree for provider: 53cf08c2-ffbf-4a19-b42f-a7314bd542ef {{(pid=71285) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.scheduler.client.report [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Inventory has not changed for provider 53cf08c2-ffbf-4a19-b42f-a7314bd542ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71285) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG nova.compute.resource_tracker [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Compute_service record updated for user:user {{(pid=71285) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 13 21:12:33 user nova-compute[71285]: DEBUG oslo_concurrency.lockutils [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.132s {{(pid=71285) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 13 21:12:35 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:37 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:39 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:39 user nova-compute[71285]: DEBUG nova.compute.manager [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71285) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 13 21:12:40 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:12:42 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:47 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:52 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:12:57 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:58 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:12:59 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:13:02 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:13:07 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:13:12 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 13 21:13:17 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 13 21:13:21 user nova-compute[71285]: DEBUG oslo_service.periodic_task [None req-7f517af5-5bc4-4694-bf04-8b997ea02632 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71285) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 13 21:13:22 user nova-compute[71285]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71285) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}